==================== ISSUES SUMMARY ==================== ========== ODH/RHOAI ISSUES SUMMARY (status, events, highlights only) ========== 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 12m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 59s Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 19m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 19m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 18m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 15m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 13m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 13m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 12m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 8m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 7m28s Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 7m52s Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 34m Warning FailedMount pod/odh-model-controller-bd4c5cbcb-df59g MountVolume.SetUp failed for volume "cert" : secret "odh-model-controller-webhook-cert" not found 34m Warning FailedCreate replicaset/model-serving-api-5679d6b4f Error creating: pods "model-serving-api-5679d6b4f-" is forbidden: error looking up service account redhat-ods-applications/model-serving-api: serviceaccount "model-serving-api" not found 34m Warning FailedCreate replicaset/rhods-dashboard-7dcc5b87c6 Error creating: pods "rhods-dashboard-7dcc5b87c6-" is forbidden: error looking up service account redhat-ods-applications/rhods-dashboard: serviceaccount "rhods-dashboard" not found 34m Warning FailedMount pod/rhods-dashboard-7dcc5b87c6-692jm MountVolume.SetUp failed for volume "modules-sa-token" : secret "odh-dashboard-modules-token" not found 19m Warning FailedMount pod/ogx-k8s-operator-controller-manager-6f9798dc69-6f6c2 MountVolume.SetUp failed for volume "cert" : secret "ogx-k8s-operator-webhook-cert" not found 18m Warning FailedCreate replicaset/maas-api-5b7784b768 Error creating: pods "maas-api-5b7784b768-" is forbidden: error looking up service account redhat-ods-applications/maas-api: serviceaccount "maas-api" not found 18m Warning Unhealthy pod/maas-controller-75bbfd978-b6748 Readiness probe failed: HTTP probe failed with statuscode: 500 57s Warning FailedMount pod/maas-api-e2e-aigw-f978966b-6547fb6d76-km9wq MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-aigw-f978966b-serving-cert" not found 34m Warning AppliedWithWarnings installplan/install-zwrjm 1 warning(s) generated during installation of operator "rhods-operator.3.5.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1 {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-19T05:46:22Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-19T05:46:28Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ed10ff3e-3d9e-48a1-ab66-c389fce09576","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bf90715b-f85f-4b51-b53b-a63f2f6f4ebe","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fc725c6-b7a0-40bd-adc0-fc8c7c3bba42","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"36dcbcc2-27ed-44c5-b461-fef3f0924d6d","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"831df1c9-0f54-45a5-9450-f66876c68a60","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"87f46327-e9a7-432d-bcb4-cf7a6bd88e8c","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e94662c5-9964-4d0f-8d11-94bcaa3c8d52","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"4564349e-2094-46f0-bfb0-791cceb05aa6","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:37Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9f6fd79-be4c-47cf-856c-f430a1bef338","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:37Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:08Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:13Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:14Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:14Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:16Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:17Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:18Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:20Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:23Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:28Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T06:01:37Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:38Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:40Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:44Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:56Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:02:17Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:03:07Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:03:47Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:04:32Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:05:23Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:06:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:07:08Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:07:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:08:32Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:09:31Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:10:01Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:10:38Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:11:35Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:12:15Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:12:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:13:34Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:14:18Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:15:17Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:16:08Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:17:02Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:17:47Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:18:28Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:19:07Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:19:46Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:20:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:21:04Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} --------------------------------------------------------------------------------------------------- ==================== STATUS REPORT ==================== ========== ODH/RHOAI STATUS REPORT (2026-07-19T06:21:03Z) ========== --- OpenShift / OCP version --- Client Version: 4.20.8 Kustomize Version: v5.6.0 Server Version: 4.21.25 Kubernetes Version: v1.34.9 --- Namespaces --- namespace/opendatahub namespace/redhat-ods-applications namespace/redhat-ods-monitoring namespace/redhat-ods-operator namespace/rhoai-model-registries --- Subscriptions (redhat-ods-operator) --- NAME PACKAGE SOURCE CHANNEL rhods-operator rhods-operator rhoai-catalog-dev beta Subscription conditions (unhealthy): CatalogSourcesUnhealthy: status=False reason=AllCatalogSourcesHealthy message=all available catalogsources are healthy --- ClusterServiceVersions (redhat-ods-operator) --- NAME DISPLAY VERSION REPLACES PHASE authorino-operator.v1.4.1 Authorino Operator 1.4.1 authorino-operator.v1.3.2 Succeeded cert-manager-operator.v1.20.0 cert-manager Operator for Red Hat OpenShift 1.20.0 cert-manager-operator.v1.19.0 Succeeded custom-metrics-autoscaler.v2.19.0-2 Custom Metrics Autoscaler 2.19.0-2 custom-metrics-autoscaler.v2.19.0-1 Succeeded dns-operator.v1.4.0 DNS Operator 1.4.0 dns-operator.v1.3.1 Succeeded kueue-operator.v1.3.1 Red Hat build of Kueue 1.3.1 Succeeded limitador-operator.v1.4.0 Limitador Operator 1.4.0 limitador-operator.v1.3.1 Succeeded rhcl-operator.v1.4.1 Red Hat Connectivity Link 1.4.1 rhcl-operator.v1.3.5 Succeeded rhods-operator.3.5.0-ea.2 Red Hat OpenShift AI 3.5.0-ea.2 Succeeded --- CSVs not in Succeeded phase --- (all CSVs report phase Succeeded) --- InstallPlans (redhat-ods-operator, not Complete) --- (no non-Complete InstallPlans) --- DataScienceCluster --- NAME READY REASON default-dsc True DSC Ready summary: True reason= DSC component states: aigateway: managementState=n/a aipipelines: managementState=Removed dashboard: managementState=Managed feastoperator: managementState=Removed kserve: managementState=Managed kueue: managementState=Removed llamastackoperator: managementState=n/a mlflowoperator: managementState=Removed modelregistry: managementState=Removed ogx: managementState=Managed ray: managementState=Removed sparkoperator: managementState=Removed trainer: managementState=Removed trainingoperator: managementState=Removed trustyai: managementState=Removed workbenches: managementState=Removed DSC conditions: Ready: status=True reason= message= ProvisioningSucceeded: status=True reason= message= ComponentsReady: status=True reason= message= AIPipelinesReady: status=False reason=Removed message=Component ManagementState is set to Removed DashboardReady: status=True reason= message= FeastOperatorReady: status=False reason=Removed message=Component ManagementState is set to Removed KserveLLMInferenceServiceDependencies: status=True reason= message= KserveLLMInferenceServiceWideEPDependencies: status=True reason= message= KserveReady: status=True reason= message= KueueReady: status=False reason=Removed message=Component ManagementState is set to Removed LLM-D-WVADependencies: status=True reason= message= MLflowOperatorReady: status=False reason=Removed message=Component ManagementState is set to Removed MaaSPrerequisitesAvailable: status=True reason=MaaSPrerequisitesMet message=MaaS gateway annotations and Authorino TLS are correctly configured ModelControllerReady: status=True reason= message= ModelRegistryReady: status=False reason=Removed message=Component ManagementState is set to Removed ModelsAsServiceReady: status=True reason=Reconciled message=MaaS platform manifests applied and maas-api deployment is available OGXReady: status=True reason= message= RayReady: status=False reason=Removed message=Component ManagementState is set to Removed SparkOperatorReady: status=False reason=Removed message=Component ManagementState is set to Removed TrainerReady: status=False reason=Removed message=Component ManagementState is set to Removed TrainingOperatorReady: status=False reason=Removed message=Component ManagementState is set to Removed TrustyAIReady: status=False reason=Removed message=Component ManagementState is set to Removed WorkbenchesReady: status=False reason=Removed message=Component ManagementState is set to Removed --- DSCInitialization --- NAME AGE PHASE CREATED AT default-dsci 34m Ready 2026-07-19T05:46:36Z DSCInitialization conditions: ReconcileComplete: status=True reason=ReconcileCompleted message=Reconcile completed successfully Available: status=True reason=ReconcileCompleted message=Reconcile completed successfully Progressing: status=False reason=ReconcileCompleted message=Reconcile completed successfully Degraded: status=False reason=ReconcileCompleted message=Reconcile completed successfully Upgradeable: status=True reason=ReconcileCompleted message=Reconcile completed successfully Ready: status=True reason= message= ProvisioningSucceeded: status=True reason= message= MonitoringStackAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR TempoAvailable: status=False reason=TracesNotConfigured message=Traces not configured in DSCI CR OpenTelemetryCollectorAvailable: status=False reason=MetricsNotConfiguredAndTracesNotConfigured message=Metrics not configured in DSCI CR Traces not configured in DSCI CR AlertingAvailable: status=False reason=AlertingNotConfigured message=Alerting not configured in DSCI CR ThanosQuerierAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR PersesAvailable: status=False reason=MetricsNotConfiguredAndTracesNotConfigured message=Perses requires at least Metrics or Traces to be configured NodeMetricsEndpointAvailable: status=False reason=MetricsNotConfigured message=Metrics not configured in DSCI CR MonitoringReady: status=True reason=Ready message=Monitoring stack is initialized --- Component CRs (Ready) --- NAME READY REASON URL dashboard.components.platform.opendatahub.io/default-dashboard True NAME READY REASON kserve.components.platform.opendatahub.io/default-kserve True NAME READY REASON URI modelcontroller.components.platform.opendatahub.io/default-modelcontroller True NAME READY REASON modelsasservice.components.platform.opendatahub.io/default-modelsasservice True NAME READY REASON ogx.components.platform.opendatahub.io/default-ogx True --- Deployments not fully ready (ODH/RHOAI namespaces) --- (all deployments report ready replicas == desired) --- Pods not Running/Succeeded (ODH/RHOAI namespaces) --- (all pods Running or Succeeded) --------------------------------------------------------------------------------------------------- ==================== EVENTS ==================== ========== ODH/RHOAI EVENTS (Warning / Error / Failed) ========== --- namespace/opendatahub --- (no events) --- namespace/redhat-ods-applications --- LAST SEEN TYPE REASON OBJECT MESSAGE 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 12m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 59s Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 19m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 19m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 18m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 15m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 14m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 13m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 13m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 12m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 8m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 7m28s Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 7m52s Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 20m Warning InvalidConfiguration servicemonitor/odh-model-controller-metrics-monitor "redhat-ods-applications/odh-model-controller-metrics-monitor" was rejected due to invalid configuration: endpoints[0]: it accesses file system via bearer token file which Prometheus specification prohibits 34m Warning FailedMount pod/odh-model-controller-bd4c5cbcb-df59g MountVolume.SetUp failed for volume "cert" : secret "odh-model-controller-webhook-cert" not found 34m Warning FailedCreate replicaset/model-serving-api-5679d6b4f Error creating: pods "model-serving-api-5679d6b4f-" is forbidden: error looking up service account redhat-ods-applications/model-serving-api: serviceaccount "model-serving-api" not found 34m Warning FailedCreate replicaset/rhods-dashboard-7dcc5b87c6 Error creating: pods "rhods-dashboard-7dcc5b87c6-" is forbidden: error looking up service account redhat-ods-applications/rhods-dashboard: serviceaccount "rhods-dashboard" not found 34m Warning FailedMount pod/rhods-dashboard-7dcc5b87c6-692jm MountVolume.SetUp failed for volume "modules-sa-token" : secret "odh-dashboard-modules-token" not found 19m Warning FailedMount pod/ogx-k8s-operator-controller-manager-6f9798dc69-6f6c2 MountVolume.SetUp failed for volume "cert" : secret "ogx-k8s-operator-webhook-cert" not found 18m Warning FailedCreate replicaset/maas-api-5b7784b768 Error creating: pods "maas-api-5b7784b768-" is forbidden: error looking up service account redhat-ods-applications/maas-api: serviceaccount "maas-api" not found 18m Warning Unhealthy pod/maas-controller-75bbfd978-b6748 Readiness probe failed: HTTP probe failed with statuscode: 500 57s Warning FailedMount pod/maas-api-e2e-aigw-f978966b-6547fb6d76-km9wq MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-aigw-f978966b-serving-cert" not found --- namespace/redhat-ods-monitoring --- (no events) --- namespace/redhat-ods-operator --- LAST SEEN TYPE REASON OBJECT MESSAGE 34m Warning AppliedWithWarnings installplan/install-zwrjm 1 warning(s) generated during installation of operator "rhods-operator.3.5.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1 --- namespace/rhoai-model-registries --- (no events) --------------------------------------------------------------------------------------------------- ==================== OPERATOR LOG HIGHLIGHTS ==================== ========== ODH/RHOAI LOG HIGHLIGHTS (errors, webhooks, reconcile failures) ========== Source: rhods-operator pods in redhat-ods-operator (since-time=2026-07-19T05:08:08Z) --- redhat-ods-operator/rhods-operator-5586fcc7f5-9qjx4 --- {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} --- redhat-ods-operator/rhods-operator-5586fcc7f5-bm5sh --- {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-19T05:46:22Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-19T05:46:28Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ed10ff3e-3d9e-48a1-ab66-c389fce09576","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bf90715b-f85f-4b51-b53b-a63f2f6f4ebe","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fc725c6-b7a0-40bd-adc0-fc8c7c3bba42","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"36dcbcc2-27ed-44c5-b461-fef3f0924d6d","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"831df1c9-0f54-45a5-9450-f66876c68a60","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"87f46327-e9a7-432d-bcb4-cf7a6bd88e8c","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e94662c5-9964-4d0f-8d11-94bcaa3c8d52","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"4564349e-2094-46f0-bfb0-791cceb05aa6","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:37Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9f6fd79-be4c-47cf-856c-f430a1bef338","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:37Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:08Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:13Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:14Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:14Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:16Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:17Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:18Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:20Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:23Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:47:28Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T06:01:37Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:38Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:40Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:44Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:01:56Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:02:17Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:03:07Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:03:47Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:04:32Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:05:23Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:06:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:07:08Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:07:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:08:32Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:09:31Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:10:01Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:10:38Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:11:35Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:12:15Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:12:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:13:34Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:14:18Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:15:17Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:16:08Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:17:02Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:17:47Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:18:28Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:19:07Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:19:46Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:20:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:21:04Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} --- redhat-ods-operator/rhods-operator-5586fcc7f5-x5nnq --- {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} --------------------------------------------------------------------------------------------------- ==================== OPERATOR POD LOG: rhods-operator-5586fcc7f5-9qjx4.log ==================== {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"Cluster config","Operator Namespace":"redhat-ods-operator","Application Namespace":"redhat-ods-applications","Release":{"name":"OpenShift AI Self-Managed","version":"3.5.0-ea.2"},"Cluster":{"type":"OpenShift","version":"4.21.25"}} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"certconfigmapgenerator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"gateway"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"monitoring"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"setupcontroller"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"auth"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"sparkoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"datasciencepipelines"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"feastoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kserve"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kueue"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelregistry"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainer"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"workbenches"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"mlflowoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainingoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelcontroller"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trustyai"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"dashboard"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelsasservice"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ogx"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ray"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:8080","secure":false} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"Attempting to acquire leader lease...","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} ==================== OPERATOR POD LOG: rhods-operator-5586fcc7f5-bm5sh.log ==================== {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"Cluster config","Operator Namespace":"redhat-ods-operator","Application Namespace":"redhat-ods-applications","Release":{"name":"OpenShift AI Self-Managed","version":"3.5.0-ea.2"},"Cluster":{"type":"OpenShift","version":"4.21.25"}} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"setupcontroller"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"auth"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"certconfigmapgenerator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"gateway"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"monitoring"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelcontroller"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ray"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"dashboard"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"sparkoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ogx"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"feastoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"mlflowoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trustyai"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"workbenches"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kserve"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kueue"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainer"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelsasservice"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"datasciencepipelines"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelregistry"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainingoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:8080","secure":false} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"Attempting to acquire leader lease...","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"Successfully acquired lease","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"cert-configmap-generator-controller","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"cert-configmap-generator-controller","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"cert-configmap-generator-controller","source":"kind source: *v1.PartialObjectMetadata"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"Starting EventSource","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"run upgrade task"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"create default DSCI CR"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"create default DSCI CR."} {"level":"info","ts":"2026-07-19T05:46:22Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"configmap","controllerGroup":"","controllerKind":"ConfigMap","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"cert-configmap-generator-controller"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"cert-configmap-generator-controller","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"fb5c4057-d5ae-47df-ab26-343dbd0382fe"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"datasciencepipelines","controllerGroup":"components.platform.opendatahub.io","controllerKind":"DataSciencePipelines","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"feastoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"FeastOperator","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"94c95e47-7ff5-4039-b7be-df1b1504467d"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"ray","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Ray","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"workbenches","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Workbenches","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"08bc8dee-34e9-4101-a3f5-c2deac4be9ac"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"sparkoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"SparkOperator","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"reconcile","controller":"kueue","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kueue","Kueue":{"name":"default-kueue"},"namespace":"","name":"default-kueue","reconcileID":"a623e447-7c1a-45e7-b9ab-9d6fe6f3bb06"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"trainingoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrainingOperator","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"mlflowoperator","controllerGroup":"components.platform.opendatahub.io","controllerKind":"MLflowOperator","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"trainer","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Trainer","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting Controller","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry"} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Starting workers","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","worker count":1} {"level":"info","ts":"2026-07-19T05:46:24Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-19T05:46:28Z","msg":"Error creating object, retrying...","reason":"Internal error occurred: failed calling webhook \"dscinitialization-v2-validator.opendatahub.io\": failed to call webhook: Post \"https://rhods-operator-service.redhat-ods-operator.svc:443/validate-dscinitialization-v2?timeout=10s\": no endpoints available for service \"rhods-operator-service\""} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3ceaff40-cdee-44ed-a1c5-d707210a171c"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3352aaa8-7b2b-4d99-9e6e-46c0a6c5c71b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"DSCInitialization","msg":"Adding finalizer for DSCInitialization","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3352aaa8-7b2b-4d99-9e6e-46c0a6c5c71b","name":"default-dsci","finalizer":"dscinitialization.opendatahub.io/finalizer"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kuadrant-system","reconcileID":"4bba5ce8-b3aa-4063-afc5-54526b0276a3"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bbd94be1-7f34-4c45-a184-0e3912e3d4ec"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"opendatahub","reconcileID":"cceafec6-ecab-4c3d-9126-302ab1d64478"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-operator","reconcileID":"b634f4e1-d9a2-4b80-833e-c50b2ff3d109"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3352aaa8-7b2b-4d99-9e6e-46c0a6c5c71b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df2964b2-3e70-46ea-898d-6c794a42e44d"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"5d7cde42-90e5-468e-9698-dc8646925ade"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager","reconcileID":"d8b98059-3bd7-4c03-9c5d-c942438ab412"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"fe8db5ab-6306-4662-80b8-685dac16a8bb"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-model-registries","reconcileID":"6fb9b565-35d0-4a26-a80f-c4111b65c16f"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"5f0cbe99-655c-4d82-a7e6-8d1675b95aa1"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"14e0a6fc-b61e-4536-820b-fd5c0e826f0c"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a","reconcileID":"11188c8c-f9df-4680-8234-60a7d00b43d4"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-ai-gateway-infra","reconcileID":"40150c48-e030-4188-b5ac-14fbc4c03980"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-monitoring","reconcileID":"af812599-cc00-4aa9-89aa-b8abffb0125c"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d532ba0b-bfd3-4a1c-8025-d6062e9d05fb"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-applications","reconcileID":"17c93b7f-0d03-4304-81da-7faf028b5f1e"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager-operator","reconcileID":"1f15d59b-b851-41f3-8fa1-dd102500ea5b"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kuadrant-system","reconcileID":"b8c31661-151b-48b9-8c62-9e31d5128ce9"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"opendatahub","reconcileID":"24b862fc-d665-44c7-838e-844cf7c6dfbc"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"176e05bd-483a-473c-ac17-af22950cdcbe","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-operator","reconcileID":"6d95ed5e-9c6d-4a43-b690-01b7545bbe83"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"bd2170c8-53b6-4623-8316-2fd68846f7ee"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ed10ff3e-3d9e-48a1-ab66-c389fce09576"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ed10ff3e-3d9e-48a1-ab66-c389fce09576"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ed10ff3e-3d9e-48a1-ab66-c389fce09576","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager","reconcileID":"7a15ceb3-573c-48e0-997c-f2be772d138a"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ed10ff3e-3d9e-48a1-ab66-c389fce09576","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"c852b6cd-975f-49e0-a4a1-0cc561fce574"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"83f90034-a8fe-4623-a549-30fdf59c3d60","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-model-registries","reconcileID":"4574273c-c817-461c-808e-169273b26199"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e1f32cc7-c466-4e5c-b657-33be9d304c76","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e1f32cc7-c466-4e5c-b657-33be9d304c76","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"c96ebd7f-4827-4a20-ba80-51b509b8271a"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ed10ff3e-3d9e-48a1-ab66-c389fce09576","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bf90715b-f85f-4b51-b53b-a63f2f6f4ebe"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bf90715b-f85f-4b51-b53b-a63f2f6f4ebe"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bf90715b-f85f-4b51-b53b-a63f2f6f4ebe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a","reconcileID":"693182d5-8cab-46f7-9c9a-17b1bf719b94"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bf90715b-f85f-4b51-b53b-a63f2f6f4ebe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-ai-gateway-infra","reconcileID":"932227b2-e95a-4d8e-b020-8b890a3ea9a0"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-monitoring","reconcileID":"ca304cb2-cb8a-4e92-9afb-81f5eeca629d"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e8ebcd85-bbf0-4772-a912-a0665c0e0320","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bf90715b-f85f-4b51-b53b-a63f2f6f4ebe","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-applications","reconcileID":"4e7ee47d-b23d-4473-8066-f98ac2835cf4"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fc725c6-b7a0-40bd-adc0-fc8c7c3bba42"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fc725c6-b7a0-40bd-adc0-fc8c7c3bba42"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fc725c6-b7a0-40bd-adc0-fc8c7c3bba42","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager-operator","reconcileID":"8bfe4c58-d3d5-4259-9f0f-db1ef602baa7"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fc725c6-b7a0-40bd-adc0-fc8c7c3bba42","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kuadrant-system","reconcileID":"ac0780da-871f-4817-9fff-8895fb2cc75d"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"09a09eaf-0d9a-472f-befd-a3932f3315d6","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2fc725c6-b7a0-40bd-adc0-fc8c7c3bba42","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"36dcbcc2-27ed-44c5-b461-fef3f0924d6d"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"36dcbcc2-27ed-44c5-b461-fef3f0924d6d"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"36dcbcc2-27ed-44c5-b461-fef3f0924d6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6aa67e4c-bb58-423a-9bdf-4b365202fef2","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"36dcbcc2-27ed-44c5-b461-fef3f0924d6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"36dcbcc2-27ed-44c5-b461-fef3f0924d6d","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"1ca24498-2c68-4319-ae15-ad27bdac1076","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3486cd4f-a199-45a0-b18e-053ecb9f4e92","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"3851834d-f472-42c7-b355-c611dca5351f","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"831df1c9-0f54-45a5-9450-f66876c68a60"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"831df1c9-0f54-45a5-9450-f66876c68a60"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"831df1c9-0f54-45a5-9450-f66876c68a60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"831df1c9-0f54-45a5-9450-f66876c68a60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"638b3887-f998-4178-b53c-6200b96357f1","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"831df1c9-0f54-45a5-9450-f66876c68a60","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"87f46327-e9a7-432d-bcb4-cf7a6bd88e8c"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"87f46327-e9a7-432d-bcb4-cf7a6bd88e8c"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"87f46327-e9a7-432d-bcb4-cf7a6bd88e8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"87f46327-e9a7-432d-bcb4-cf7a6bd88e8c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"8e7c0f4a-e1a0-46b3-b33a-62b6406d1e40","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"87f46327-e9a7-432d-bcb4-cf7a6bd88e8c","error":"provisioning failed: failure deploying resource /monitoring-labels-values-validation: apply failed admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy: unable to patch admissionregistration.k8s.io/v1, Kind=ValidatingAdmissionPolicy monitoring-labels-values-validation: validatingadmissionpolicies.admissionregistration.k8s.io \"monitoring-labels-values-validation\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Monitoring: no matches for kind \"Monitoring\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e94662c5-9964-4d0f-8d11-94bcaa3c8d52"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e94662c5-9964-4d0f-8d11-94bcaa3c8d52"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e94662c5-9964-4d0f-8d11-94bcaa3c8d52","error":"provisioning failed: failed to create auth proxy secret: secrets \"kube-auth-proxy-creds\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind GatewayConfig: no matches for kind \"GatewayConfig\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"4564349e-2094-46f0-bfb0-791cceb05aa6"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"4564349e-2094-46f0-bfb0-791cceb05aa6"} {"level":"info","ts":"2026-07-19T05:46:36Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"4564349e-2094-46f0-bfb0-791cceb05aa6","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"error","ts":"2026-07-19T05:46:36Z","msg":"Reconciler error","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"4564349e-2094-46f0-bfb0-791cceb05aa6","error":"provisioning failed: failure deploying resource redhat-ods-applications/data-science-admingroup-role: apply failed rbac.authorization.k8s.io/v1, Kind=Role: unable to patch rbac.authorization.k8s.io/v1, Kind=Role redhat-ods-applications/data-science-admingroup-role: roles.rbac.authorization.k8s.io \"data-science-admingroup-role\" is forbidden: cannot set blockOwnerDeletion in this case because cannot find RESTMapping for APIVersion services.platform.opendatahub.io/v1alpha1 Kind Auth: no matches for kind \"Auth\" in version \"services.platform.opendatahub.io/v1alpha1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b18e07e-af82-4db3-9d7f-08f12760959d"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b18e07e-af82-4db3-9d7f-08f12760959d"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"opendatahub","reconcileID":"0783e214-31c1-4934-9d7e-d94d3b586094"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9f6fd79-be4c-47cf-856c-f430a1bef338"} {"level":"info","ts":"2026-07-19T05:46:36Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9f6fd79-be4c-47cf-856c-f430a1bef338"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"c0e61643-d001-4e47-8965-b95a5be64d85"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"c0e61643-d001-4e47-8965-b95a5be64d85"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"c0e61643-d001-4e47-8965-b95a5be64d85","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Dashboard CR not found, cleaning up dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9f6fd79-be4c-47cf-856c-f430a1bef338"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"815fc36a-b1ea-46b3-a49d-e93350c008b1"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"815fc36a-b1ea-46b3-a49d-e93350c008b1"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"aad34f8b-6986-4462-99c1-a05647e51d46","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"aad34f8b-6986-4462-99c1-a05647e51d46","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"03040d43-6feb-4813-ad6b-b10323ef3456"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"03040d43-6feb-4813-ad6b-b10323ef3456"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c9f11824-f009-452c-9cdf-85df1e04c1cb","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c9f11824-f009-452c-9cdf-85df1e04c1cb","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-operator","reconcileID":"6167dd1e-99e1-479b-a93e-3c7cb2303f0e"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"c0e61643-d001-4e47-8965-b95a5be64d85","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"c0e61643-d001-4e47-8965-b95a5be64d85","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"517e2a2b-6964-406e-9d38-372941bfeaa5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ff00faad-1539-46c5-ac59-d47995ec3c8e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3e1452bb-8854-4b2b-b5cb-ab57692a6687","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3e1452bb-8854-4b2b-b5cb-ab57692a6687","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f5aae164-b4d2-4357-85e0-61e6b8a3af6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T05:46:37Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a9f6fd79-be4c-47cf-856c-f430a1bef338","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Dashboard CR not found, cleaning up dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"d890d203-3b67-44c0-b52a-27b757841e1f"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b0e906c6-41ba-42e2-a62b-aa4e86fd73c0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T05:46:37Z","msg":"Reconciler error","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"5bcb5089-50fc-48c6-bc9e-a93b50bc38f0","error":"provisioning failed: failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager","reconcileID":"fca3edf6-92fb-496a-8361-689d08bc7dd6"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"080913bf-29b3-4eee-8418-39655ae1f3c8"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"599deb1f-a686-40f3-bd9f-05932d3fc855"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d993dfd5-1872-4de0-b81a-c52cf08b7983"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"46935212-c38c-496f-a602-2cd0c6523f60"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9550af6b-05d4-43d3-a621-de8f0eb8092e"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"e2f8e414-bb97-4677-aa22-a52ed9a26a2d"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"47d9adbd-6d07-4874-9ea7-5c474ebcfe7e"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"e7ea2477-fff5-4ccf-83f8-b237ca8cd5b9"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"46b8462c-32fe-4aa4-a491-ebc24789fdde"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a1208ae-1c41-4bc8-9c91-4f93eaf8369d"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"bf78cf75-885c-45a3-b213-9c4608371207"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f964fe0a-aa96-481d-a31c-8f541313e0c6"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2edecd31-9be4-4cdc-a1f3-dd585844d16c"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Dashboard CR not found, cleaning up dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"78d61ce4-4921-4e2e-bc7f-06a4da24bf32"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f3723222-72da-416f-a3a0-f5842fb0c55d"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5663a56a-b506-4d4e-9b1c-ce6bc2542155"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"1a7bb011-3578-4dd5-ae7e-5d39e29433be"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f2bf5579-91cf-4f61-bce1-53195d7cc300"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"00158a87-b92d-4e2e-82be-2078db7e7268"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6864910e-8c8c-46b3-8e67-c3be034eecfc"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"edd3afaf-f680-4c39-9f03-2ad4d97921c6"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"f3199ed5-bd8f-4cd0-b1bc-64912296d036"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"3eeb41de-8135-401c-ad83-4632cc53f10a"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2ee54b4b-dd72-4d75-a769-15b387dd8218"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7e065c7e-c62f-4341-855e-4608aa547fe0"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"986371b9-be46-41d8-8d5d-00578d9e6915"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"324c1f45-2ac5-4a66-92d6-f91aa8fa132c"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"89c1a051-6168-4130-b96e-2b4092845271"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"167a48c0-2302-4192-a3be-c8b391a2b9fa"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"c38d1212-b3b6-4366-a516-53168ff3239b"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"e4c6a48a-8396-4e8a-a907-bb27840ee5ef"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"06cd89d7-63cb-4201-a580-6da95171234f"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"7936d4ea-29f6-498e-adab-e2e90a0560b4"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d6aa46db-5926-401b-b1b7-98ec6a04ef78"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"82221e9f-ae9d-4d8c-b4c4-5c419fd45b08"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"99b35988-602f-47ab-a97b-640ed2a50599"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"acd26437-9a64-4c48-a0b4-9030fe64adf5"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"15856162-7f75-4408-b257-e308629feaba"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5498684a-f4e8-491a-87d9-e056fce2782d"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a79c9d57-d3f6-4826-aea1-4250e7c2a7fe"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"60ded639-b1a3-4a0b-8a1d-c31fa8aa5fd9"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"570c8a5d-df0d-4c8a-9ab2-335528baacc2"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"70b73b47-e6e9-4613-abe2-da2011721f35"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-model-registries","reconcileID":"efd35006-5178-424d-a9de-4e08fcea8391"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3e3b0f0f-0f3b-4b91-b63c-cc76b1fa9b2a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:39Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c8355406-2383-484e-b3df-3b83f0bbe5cf","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c8355406-2383-484e-b3df-3b83f0bbe5cf","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"b32312ed-5cf1-4c08-b612-96893d42369c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"a8f46740-03fd-4a78-97e0-f54c08937150"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d47c56a0-087b-4fef-822d-c869c118a00a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d47c56a0-087b-4fef-822d-c869c118a00a","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cab44dd3-79ca-4e7d-a4ac-e0483037056f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a","reconcileID":"df6a00ed-d100-4d8f-8165-79301ea97007"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e490b880-7732-4efb-ab6b-c6fe9a39748d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Starting EventSource","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Dashboard CR not found, cleaning up dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6b71e75b-395d-44f7-ae3a-fcc222f6ff0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"reconcile","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc9cda5e-86f0-46c6-9f74-56175d6c4654","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"apply","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.initializeModules"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules"} {"level":"info","ts":"2026-07-19T05:46:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:40Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules","msg":"module CR gone, cleaning up operator resources","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","module":"aigateway"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-ai-gateway-infra","reconcileID":"86cef015-7831-4fe3-8ed7-09298ce85b5b"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager","reconcileID":"97f7a14e-e777-4685-a3e0-7fe0979d51d3"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"adding finalizer","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"reconcile","controller":"modelregistry","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelRegistry","ModelRegistry":{"name":"default-modelregistry"},"namespace":"","name":"default-modelregistry","reconcileID":"3b7f5e86-d13e-467a-b0aa-7f49c6a7f3f7"} {"level":"info","ts":"2026-07-19T05:46:40Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1a41f8f2-dda4-4bcb-988f-6de342ad9d3e","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1a41f8f2-dda4-4bcb-988f-6de342ad9d3e","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"a888faa7-da9a-4a51-afff-861ad2aa8b4b"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:40Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-model-registries","reconcileID":"16eb4940-273b-444f-a1d8-cbc745837df8"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"68b3c1a9-e9eb-4ca0-ae9a-59b6338053b6"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3af597f4-489b-4544-9b16-dd512f7de8ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:40Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a","reconcileID":"4a5a5ac0-b0e5-4baf-8e98-3eadb600c942"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-ai-gateway-infra","reconcileID":"12852450-8b41-4544-8167-4bcfadb63837"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.provisionModules"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/helm.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.injectModuleEnv"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.updateModuleStatus"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'patchesStrategicMerge' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-monitoring","reconcileID":"c9ca7fcc-2380-44c2-b27f-09c005f3ca4e"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-applications","reconcileID":"823465f5-c937-4742-bdb5-1df8c286b3ae"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5f1d6bb9-925d-4069-9bce-089af4278026","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dynamicownership.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"reconcile","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"apply","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.initializeModules"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:41Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules","msg":"module CR gone, cleaning up operator resources","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","module":"aigateway"} {"level":"info","ts":"2026-07-19T05:46:41Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager-operator","reconcileID":"203f7b5e-edd1-411a-ae7b-c6286a14d252"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1f3dba54-215b-4c03-8561-618d11a9585d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kuadrant-system","reconcileID":"9bb4e425-4ec4-475e-82fb-56bd80812d9e"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"opendatahub","reconcileID":"ea4f5a26-3982-4f3f-8697-b80a9b13111a"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-operator","reconcileID":"0303664a-ec4c-4d06-a4ab-05597019c41f"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:42Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e32e8db8-986d-437b-b3e3-23ea4ea759e8","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e32e8db8-986d-437b-b3e3-23ea4ea759e8","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"ca848c13-4f5a-4521-b87f-eef31a5387c8"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"98bde24a-2e8e-40e3-a9c4-dd8e6afdb42b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:42Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager","reconcileID":"3a81f0bb-06da-4b23-940d-93fc98e5737d"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.provisionModules"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/helm.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.injectModuleEnv"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.updateModuleStatus"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"87e6f083-d18a-45df-a2d2-3513746b8b40","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dynamicownership.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kyverno","reconcileID":"614bdc68-d5fd-4f85-bd3f-8441ff01ddf9"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-model-registries","reconcileID":"89ab389b-d517-4231-9725-8e5516e0d306"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-agent-addon","reconcileID":"e3636993-0e5b-4e1c-b730-a0e1b636fae2"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a","reconcileID":"412528f2-07f7-4074-8f4e-e7bc70d7b98f"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-ai-gateway-infra","reconcileID":"018ae95c-13cf-406c-882a-16dcadb8fd2d"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e91873f1-8c5e-4075-bd1a-d3da5bbdde86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-monitoring","reconcileID":"ac24b9f7-efe8-4dd8-ab7d-54df88200904"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-applications","reconcileID":"ef160ad3-d1ad-456a-8bfa-4670e1860137"} {"level":"info","ts":"2026-07-19T05:46:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"cert-manager-operator","reconcileID":"b9c02acc-87b4-4979-917b-025dca7de5df"} {"level":"info","ts":"2026-07-19T05:46:44Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1d69e9f6-c0ff-4dc4-ba28-df5bbfd80946","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1d69e9f6-c0ff-4dc4-ba28-df5bbfd80946","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"kuadrant-system","reconcileID":"3b6f8272-fe05-465d-acea-a4e45face109"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"opendatahub","reconcileID":"5922ff43-d6f1-4974-9f53-caa6e4f3ca88"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6283bbe9-22ef-45b1-befa-23c68f2b2874","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"redhat-ods-operator","reconcileID":"294c682c-e300-4a3f-9357-3b3e83af642f"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"rhoai-model-registries","reconcileID":"0e388821-beb3-42b0-a5c0-7642fd57e570"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:44Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c5e33c8b-3149-4d65-8591-3ad1fff63ab1","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c5e33c8b-3149-4d65-8591-3ad1fff63ab1","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"016e8e2d-d433-41bd-9324-a86b5aabd60e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df7a9cd7-b40f-45de-a1b1-f7d47d9b5a5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:45Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:46Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"15ab509f-0728-4d87-b410-6835401b62fb","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"15ab509f-0728-4d87-b410-6835401b62fb","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e3e16ac9-36e0-4da5-8f32-4b9b37333a2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:47Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d0df4bcc-75d5-4dfe-8311-859d5d51da11","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:47Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d0df4bcc-75d5-4dfe-8311-859d5d51da11","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:48Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"e160208d-77ed-47ba-9e93-1d6d403209cc","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Starting EventSource","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"ac70042e-af5d-4318-bcec-535673315f16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"1f113d2c-5d90-4174-89ce-e6320f55f980","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"80faf646-3ee0-415b-889a-9c1628a78fad","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5dcfb160-e564-4dde-bd67-52c4a20f0b8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:50Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"21228f5e-bbd5-4288-8cee-b9cd5e93a1c0","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"21228f5e-bbd5-4288-8cee-b9cd5e93a1c0","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:50Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"68ec5935-2e69-49ca-8303-1dc28c9837cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"47720aa5-5be2-4516-b21a-1ed2085c8bc3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"515db3f9-110e-4624-8cd7-e47731dca1c1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:50Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure.detectAndSetIngressMode","msg":"Detected ingress mode from existing Gateway Service","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","mode":"OcpRoute"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:50Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:46:50Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:51Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"42e9f93a-875b-479c-a414-8d8e6971b146","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"42e9f93a-875b-479c-a414-8d8e6971b146","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"332f62e6-1e42-4db0-97b4-e573d1365f14","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:51Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm","msg":"EnvoyFilter exposes internal implementation details that may change at any time. Prefer other APIs if possible, and exercise extreme caution, especially around upgrades.","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:52Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9cfd737f-f203-492b-b1db-95ad66c3f67b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9cfd737f-f203-492b-b1db-95ad66c3f67b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"21539ae0-96c7-4781-a963-b60b581bd79d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:53Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"a611c9d5-c6bd-4ec5-b514-a89e27b288aa","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"a611c9d5-c6bd-4ec5-b514-a89e27b288aa","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"385e56cd-9a3b-4a93-872f-c864830c65e3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:53Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bfc1d23f-3f13-44d4-ab1b-5222248ca92a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"bfc1d23f-3f13-44d4-ab1b-5222248ca92a","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:53Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"886b4132-a968-4dd3-8e89-e1f817705889","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:53Z","msg":"Starting EventSource","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b7ca3b2b-ff9d-4852-b28f-051e96d55322","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cab1c68b-7031-45fc-a644-8a9157d4d6ba","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:54Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e83bc54b-bf07-49a5-bff4-b11ecd28562b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"e5aee869-2e28-46c3-8f72-3992cb33d6fe","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:55Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"336d79d1-e418-46ad-a9fe-dc59ff7391d4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:55Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"07345bf7-7416-4c85-b5a7-89a034868ced","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:55Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"07345bf7-7416-4c85-b5a7-89a034868ced","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0f0b44b-ebf2-40b4-bccd-2c5bd9a619d5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:56Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:56Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f1471d40-a56d-40ea-8a85-09caf0df3ad2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-19T05:46:57Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8801d9d8-e7d3-4da7-b4d6-6b74a42edec0","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8801d9d8-e7d3-4da7-b4d6-6b74a42edec0","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"5651e288-24fb-472f-a117-4730b1eef5d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:46:57Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4f192764-5cdc-4b49-a795-dca9d089fd06","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:57Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"053e1a6a-b2ab-4718-8205-05afd41f951c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"646befcd-49c9-4cee-a858-7b7e69052e23","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:46:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"61bc5c0f-a384-42a6-8bfe-e733ed982be1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5887e681-8f6e-47f4-9e2a-3d9b62a20f86","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:00Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"b4e82586-ff06-4377-9887-01d70e4bd240","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"b4e82586-ff06-4377-9887-01d70e4bd240","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"caeb9e1b-6fbf-4db9-a35e-733d18fb593d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"reconcile","controller":"trustyai","controllerGroup":"components.platform.opendatahub.io","controllerKind":"TrustyAI","TrustyAI":{"name":"default-trustyai"},"namespace":"","name":"default-trustyai","reconcileID":"53d190b7-468f-4dbd-b26b-34dc847a7487"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"42521d1b-ca13-4228-949e-971984ff2760","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"369b9f41-a2d9-459f-95b7-84d669f5d2f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:01Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2ffe5da5-dc58-49c5-846f-6cc75d1649d8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4e5a6b7a-f352-4ff5-96a5-ed154cb7eaa1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7168c274-bc81-4142-b4a8-0d0ba43e4466","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:01Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:01Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f61d51e8-d274-4278-89ec-88cf9a9e3ed7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:02Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6efd662b-72eb-4c50-b255-5af6a0fc2610","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6efd662b-72eb-4c50-b255-5af6a0fc2610","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"3049c5bd-0509-4c1f-9765-8684ce669e8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:02Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1caa2895-e76f-466e-9ffc-c9cc7765c38d","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:02Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1caa2895-e76f-466e-9ffc-c9cc7765c38d","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8d1bc4f8-08b5-4403-9b9e-ca77fe067b29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:04Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"27525d09-5567-437f-9c38-86cc3002bc00","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"27525d09-5567-437f-9c38-86cc3002bc00","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"adc933d7-0b25-4532-baf8-d69a0418e49e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"e7d5494c-0748-4a73-8b63-640d7a510db1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:05Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fc50efe4-1d6f-44b6-ba06-88412c3fcd6e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"73b4f609-3de2-4a51-93d6-6321364c543a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:07Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:07Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cd28e617-5b86-4263-abee-70ee05fbff6b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T05:47:08Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"530f0d7f-e491-40fe-ae22-3f5d072912f0","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f976568a-71f0-4436-a622-7856e103bf92","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"a2434cc3-5e21-4265-b941-0b01f4b01ef3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"72be4a65-b458-4436-9d7a-aef7ad2906cb","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"72be4a65-b458-4436-9d7a-aef7ad2906cb","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:12Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b158d72f-73e3-498f-979e-c5e214e1e54f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c5788afa-0c52-49d7-a42c-2084e921521e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:12Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"416e294b-709f-470c-9491-e35d33999bbf","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:12Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"416e294b-709f-470c-9491-e35d33999bbf","name":"redhat-ods-applications"} {"level":"error","ts":"2026-07-19T05:47:13Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9dddee64-c3da-4c9a-9d95-b945129ca177","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7e227cf-ae4a-479f-a1c3-82b64a4c6f7b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:13Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:14Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b99ebb80-a8d0-4316-a22f-bf13393c2ac8","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:14Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d7ca159a-0399-4f13-b0a9-308fcc47bf2e","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:14Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"5ee80785-9213-45df-ad4b-57e20f4bdb0c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:15Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"350f7be6-5770-46fd-abb0-f389f037c91a","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c"} {"level":"info","ts":"2026-07-19T05:47:15Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:16Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"a6c24401-dee3-41ca-98d5-41d680e3569c","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:16Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:17Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d4beb7c2-a034-4c7d-b1ea-be186704e754","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:17Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde"} {"level":"info","ts":"2026-07-19T05:47:17Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:18Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:18Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"10b9ccd4-225e-48a4-8bdb-0849e6c1cfde","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:19Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:20Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"d73e7f35-c0f2-4c44-b2df-0c854330deb6","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:22Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:23Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9c743a0e-4121-494f-b56a-563e65ab44cd","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:28Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"error","ts":"2026-07-19T05:47:28Z","msg":"Reconciler error","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"eba237fd-6fc1-4992-b6f7-cea014e2a434","error":"provisioning failed: failure deploying resource redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig redhat-ods-applications/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook \"llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator\": failed to call webhook: Post \"https://llmisvc-webhook-server-service.redhat-ods-applications.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s\": no endpoints available for service \"llmisvc-webhook-server-service\"","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdb36a0f-41ec-4bef-9433-607ffc017ce8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"6d1178b8-9834-4e93-8c38-b5244d6a02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"6cc6f4a4-9a32-4e5e-bbb9-578d71fe94fd","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:38Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"cdfb14bc-6e89-46b8-9b2b-7381e43bef54","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:39Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"f87388ce-8456-4542-bfcc-262a924e11c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Starting EventSource","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5e496f61-e826-4fcb-9bbf-4c92b2a61a3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"01ec60c0-bb3b-44bf-ae32-523156a4df1a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"844007e4-f78a-4396-8d69-033ab622e1ec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"0a88abf5-4aa0-4c3c-9a7a-5252eee97a70","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8ac37ac0-9683-49e9-b573-6270d9de7bb1","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"8ac37ac0-9683-49e9-b573-6270d9de7bb1","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"076547c3-6b40-4e8f-93ba-168ba0fe535e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:41Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:42Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T05:47:42Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:42Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:42Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"2c9f2287-657d-458d-b557-0bacc84b00fb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:42Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358"} {"level":"info","ts":"2026-07-19T05:47:42Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"834776f5-79cd-4fd6-9104-648cf2fed358","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:43Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"b96bcc1a-02d9-4c7d-b252-49ad89f6af69","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:44Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"8bd993b3-3298-4f23-a6a7-159b7e81d973","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"322e09dc-a5bc-4680-8cff-213f2cbc674e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:45Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"82e022bc-fbc7-4a40-af84-4709546e8cc2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:46Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"bd63b628-6e7a-4f5a-a006-0ad8b928e8a1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a7f187fd-b20c-49ca-a665-ccbeff11bbb9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"56a37cb6-c608-4a2e-8b0f-985c9fa9e8e6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:47:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ae5072d2-4aa3-421a-add6-b41645bb6447","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7eb28a1f-07e0-4685-acde-017502321d13","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"cd3a8ef4-69ff-4627-a5ac-68e7b044aeff","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:47:47Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"5ff1e90e-4646-4083-9d90-d33d0f2ce9db","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:47:47Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"5ff1e90e-4646-4083-9d90-d33d0f2ce9db","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:49:22Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:49:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9ea03aa4-3ca8-4044-9503-523a803876d0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:50:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:50:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ee08b980-51e3-4246-b70e-fdd1ff415721","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:50:52Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:50:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a99f95a6-f770-4967-ac47-da791c3db1b8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:51:22Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:22Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a515c418-3660-48f1-a01e-24f2e5cdb1f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:51:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"03f79dd8-aeea-45da-8968-ffd59aec2934","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:51:52Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda"} {"level":"info","ts":"2026-07-19T05:51:52Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda"} {"level":"info","ts":"2026-07-19T05:51:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:51:52Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:51:53Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:51:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"fb777141-83b9-4372-b16c-c26cb49e6bda","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:53:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:53:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3cbb9b10-ab01-416f-8c40-3ebbbfbe6b02","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:53:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:53:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1b27bb35-4503-4148-961d-ddf202322f58","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:54:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:54:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"92cda364-3363-494a-9755-921a8cdd9464","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:54:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:54:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31b91940-e98b-4c2e-894f-8f7d263dfb8f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:55:08Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:55:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0a909729-03ca-4d50-b2e4-515651a6e71d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:55:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:55:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"abc7d8d3-b312-4bca-a1c4-b7af25149dd6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:56:53Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16"} {"level":"info","ts":"2026-07-19T05:56:53Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16"} {"level":"info","ts":"2026-07-19T05:56:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:56:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:56:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:56:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm","msg":"EnvoyFilter exposes internal implementation details that may change at any time. Prefer other APIs if possible, and exercise extreme caution, especially around upgrades.","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:56:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0f01f7f0-60f7-4b25-8dd8-da509bfe6b16","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:59:08Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"8f2411f2-c683-462d-949f-363a52a296bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:59:08Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"9bf64770-8a6b-404e-b18b-52d61684c586","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f3ceeab6-701e-4c26-becc-a2788b240d05","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:59:08Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"7e4e8d6d-5ed1-4e65-9f55-fc4891ea4ec3","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T05:59:08Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"7e4e8d6d-5ed1-4e65-9f55-fc4891ea4ec3","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:59:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"f32ade9e-1ad0-46c7-8235-4be7dfef6e07","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T05:59:53Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T05:59:53Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c096da1a-0769-41a0-9f8d-2fa05e276e60","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:00:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:00:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"aea5fcc6-04dd-4cab-96b6-bef7fa6ad0fa","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:00:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:00:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"cb226dd3-359f-41c5-aab2-566c00f9841c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"50521c8a-f3f8-4cf7-893e-f37e1a5cc268","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"28706fac-2fc2-4688-ab73-314498b8db2f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"28706fac-2fc2-4688-ab73-314498b8db2f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6b56e904-f8c5-495b-9362-251e9ce93d79","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"efe81803-b0c7-435f-86bb-7bd904c25668","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:01:08Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4b3a3608-96ed-451f-9347-fe7a6ccc0c63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"76e46645-61d3-4a40-b845-da19fdc0ebbb","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:15Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"87390b43-2b00-4fad-9e8a-f8e8cdc1d167","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:15Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"87390b43-2b00-4fad-9e8a-f8e8cdc1d167","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:01:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"db62003e-eb75-486b-b1b1-bdf3390f965a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"bc4c9b25-d934-4e16-a939-e636e91238ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c6e6bd41-15b6-4d87-a99d-c5ca79b53a7b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c6e6bd41-15b6-4d87-a99d-c5ca79b53a7b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:34Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ce5336aa-d90d-45a2-9fa8-844be3eb016e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"90726260-f72f-4d9a-9202-dc89331583ee","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:36Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e10a20f0-449b-4ca0-839c-00294f24dea2","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"e10a20f0-449b-4ca0-839c-00294f24dea2","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:36Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4018f4ba-e983-46aa-9811-f700e005a157","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.initializeModules"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1"} {"level":"info","ts":"2026-07-19T06:01:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules","msg":"module CR gone, cleaning up operator resources","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","module":"aigateway"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"abe80676-916f-4bfe-baf2-7300ad95a9b6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:01:37Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.provisionModules"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/helm.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.injectModuleEnv"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.updateModuleStatus"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"21243e96-3adf-443a-a081-aa9d0f9c930a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"21243e96-3adf-443a-a081-aa9d0f9c930a","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"c9ecd000-4f33-4a80-9ea9-9a325a6f02d6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dynamicownership.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e66b4f30-0bcb-4893-b000-826b22589f3d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:01:37Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.renderMaasOperatorInstall"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T06:01:37Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} # Warning: 'commonLabels' is deprecated. Please use 'labels' instead. Run 'kustomize edit fix' to update your Kustomization automatically. {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"ce9067e2-3fd1-4c6c-be8e-e24068895a15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:01:38Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"a2a038fe-03c6-4226-b672-ff763f69bbf1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:38Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"421413a4-cf3f-4258-9088-d241c589844a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:39Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"a8ef214a-ffda-442a-9daa-698529c4f577","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"a8ef214a-ffda-442a-9daa-698529c4f577","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4cc86351-fb7a-42a3-b108-12383cee807c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.ensureMaasClusterConfigControllerRef"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:39Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4fb30fd7-6471-48e9-bbbc-0b8a7c4ddbe7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:01:40Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:40Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d93ed907-0fdf-49e1-9f41-f2b829b2cbe2","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d93ed907-0fdf-49e1-9f41-f2b829b2cbe2","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"feabe0ff-82e3-457e-b0c9-e0fc02dbcf7d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a9d128-54da-4bff-8f1a-4a59fbbd8c9b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Starting EventSource","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T06:01:40Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"29c847be-16d1-490c-9a84-8084ed4bb768","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:40Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"29c847be-16d1-490c-9a84-8084ed4bb768","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"55ae4391-9b51-4fc7-926c-a21f50b1c379","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"reconcile","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"apply","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.renderMaasOperatorInstall"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"ce7fdcc8-de5a-4f95-881b-921d0a523fec","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.ensureMaasClusterConfigControllerRef"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:41Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"e7caeedb-dcff-4362-819a-271ddb347801","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"43a5c991-ec29-4b77-976e-ae182f83be6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:01:42Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"342e75a0-bc20-48e3-a243-b2985855e42d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"reconcile","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"apply","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.initializeModules"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"de37516b-77ce-4aed-9de0-6a2de74eb22b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.cleanupDisabledModules","msg":"module CR gone, cleaning up operator resources","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","module":"aigateway"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"269b6f0d-e0ba-429b-af63-aef1054e81cf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:42Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"reconcile","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"apply","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Pre-condition skipped by runtime predicate","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a","conditionType":"LLM-D-WVADependencies"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelcontroller.initialize"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"reconcile","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"apply","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.initialize"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.deployObservabilityManifests"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"apply","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.initialize"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelcontroller","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelController","ModelController":{"name":"default-modelcontroller"},"namespace":"","name":"default-modelcontroller","reconcileID":"4b9ab424-7c8a-447a-b847-1bc6d892ce4a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"reconcile","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"apply","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.renderMaasOperatorInstall"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.setKustomizedParams"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.configureDependencies"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"models-as-a-service","reconcileID":"b6f18be0-bd6b-4f3b-a15a-bbe014cf1332"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ai-tenants","reconcileID":"a95b0d98-52c3-4e93-9592-e4a3e51501ac"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"error","ts":"2026-07-19T06:01:44Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.ensureMaasClusterConfigControllerRef"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"6092e46b-7cdd-426c-a51a-4bfc3d3d085b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"models-as-a-service","reconcileID":"5922dcd9-5c61-47b8-ab79-7d1737912596"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"4c4c473b-b414-4d6d-a54a-0670cdc6fd4b","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.provisionModules"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/helm.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.injectModuleEnv"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/modules.updateModuleStatus"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ai-tenants","reconcileID":"e86d1054-9752-4bb0-9b13-4908660801ab"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:44Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"fc5bad40-2754-42af-ba07-51ff041b476f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"fc5bad40-2754-42af-ba07-51ff041b476f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"2c286923-b60b-4e59-9112-b882563d1a57","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"modules","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e9682573-40f5-4b8c-81ad-c00b6f296896","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/dynamicownership.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:44Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f7ad2658-24a4-4826-ba14-30e64ee7b38c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"06afb830-70c2-4622-a826-b7028dd49977","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"06afb830-70c2-4622-a826-b7028dd49977","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"44d97bc7-0186-46f4-a87a-d89de7e9f554","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"5059acf2-afdb-4c18-9153-b77d3234ff00","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:46Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"43a1e7c4-e8b2-4a62-acd5-fa328fa77b37","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"43a1e7c4-e8b2-4a62-acd5-fa328fa77b37","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:46Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eaffa874-c126-41b0-8eaa-bef1ccac83a9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"76b7acfe-68a1-4b62-b8be-cd678777e63b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"76b7acfe-68a1-4b62-b8be-cd678777e63b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f"} {"level":"info","ts":"2026-07-19T06:01:47Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"19103366-b92f-4dfc-841c-634b1674cc5f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"26a48b39-abee-46e0-b87a-dab0606476f5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.reconcileHardwareProfiles"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/dashboard.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"dashboard","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Dashboard","Dashboard":{"name":"default-dashboard"},"namespace":"","name":"default-dashboard","reconcileID":"fab36f32-d9a8-4573-8af3-0cf547122e3c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"fceb4c9a-9641-4370-b84d-139a1bbcac63","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed"} {"level":"info","ts":"2026-07-19T06:01:47Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"apply","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.initialize"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:01:48Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"63484d5b-204a-4ac0-b608-0e98146014ed","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"44875a48-0ad3-4540-bca9-ca96cc230b45","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"7ebca25e-f54c-4525-8280-f3d865126642","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:48Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"df576ce6-4e28-4454-9550-a0cd2b0387ce","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:49Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"9f33bd6e-09ec-44ff-be1e-3faa81f50ce6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:49Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3c7c52d1-becd-4511-b0cd-abda12b024df","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:01:49Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"3c7c52d1-becd-4511-b0cd-abda12b024df","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:53Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T06:01:53Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T06:01:53Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"reconcile","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"apply","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.renderMaasOperatorInstall"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/modelsasservice.ensureMaasClusterConfigControllerRef"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"modelsasservice","controllerGroup":"components.platform.opendatahub.io","controllerKind":"ModelsAsService","ModelsAsService":{"name":"default-modelsasservice"},"namespace":"","name":"default-modelsasservice","reconcileID":"b49ba4e4-be7f-46fb-9738-b7f1e10fcc35","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"fcb82236-f80f-4254-bb75-bf5ba72cf115","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:01:56Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"9bc385bc-3886-4334-a642-52d060d057d7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"reconcile","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"apply","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"2a6929bc-af62-45b7-aa14-1ccc2c990e73","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.initialize"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.removeOwnershipFromUnmanagedResources"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.cleanUpTemplatedResources"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.customizeKserveConfigMap"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.(*componentHandler).NewComponentReconciler.func1"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"reconcile","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"apply","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.initialize"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/ogx.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/releases.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/kustomize.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"ogx","controllerGroup":"components.platform.opendatahub.io","controllerKind":"OGX","OGX":{"name":"default-ogx"},"namespace":"","name":"default-ogx","reconcileID":"5f6ec700-a15b-481d-bcb9-103a09177523","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:01:59Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/components/kserve.reconcileModelCache"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"kserve","controllerGroup":"components.platform.opendatahub.io","controllerKind":"Kserve","Kserve":{"name":"default-kserve"},"namespace":"","name":"default-kserve","reconcileID":"6dbebeb8-00bc-492e-a46f-2ec0d8e946bf","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"f4a97c38-eccf-4fd7-bbfb-4cdd0d6f7265","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5f3cc26d-9586-42a4-9c1d-779c26f4527c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"03313c66-9c8a-4218-86d2-66f965dca7ae","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:00Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ed7fb38c-5104-496d-9d00-367b5270cf78","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:02:00Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"ed7fb38c-5104-496d-9d00-367b5270cf78","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"72c4eb4e-a24d-42ae-88c9-f23b6672aba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"8ad8fbc0-2fc1-4e4d-b00f-49dd9d654dc0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:14Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1ce1d17f-3cf4-47b3-9bea-0419836d37a5","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"1ce1d17f-3cf4-47b3-9bea-0419836d37a5","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e0da7d09-da3d-42e4-a50f-8a2b9ab5a84c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0b2bf91f-ec65-4732-9564-1407e835eb8b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0b2bf91f-ec65-4732-9564-1407e835eb8b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c3177591-8f4b-4347-a33a-e6bfedd8d239","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"30889b3a-ab29-4d24-a57a-416596b31488","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9699dcfc-ee85-4920-8616-a5939c19e978","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"e7c85c53-fd68-4488-a26f-2d304488fb29","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"dd3c0c25-2094-4400-9ec4-66ea76c16c02","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ea6ab6ea-05cb-4293-8d95-3814b66ff35b"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ea6ab6ea-05cb-4293-8d95-3814b66ff35b"} {"level":"error","ts":"2026-07-19T06:02:17Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:20Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"978f2dd6-d868-499e-bec9-bd88bd9a0cd1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T06:02:28Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:28Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206"} {"level":"info","ts":"2026-07-19T06:02:28Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"b229ccdd-1a9e-47e8-84ad-c33791a46206","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T06:02:29Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions","msg":"namespace not found, skipping RoleBinding creation","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","namespace":"models-as-a-service","roleBinding":"data-science-admingroup-maas-rolebinding"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:29Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"99abca95-dccb-4dff-93b9-e3d608f08a82","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:37Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"odh-ai-gateway-infra","reconcileID":"5f4f8b7e-5da6-4863-ba66-4096ae53a894"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"models-as-a-service","reconcileID":"ca03870b-fcfe-4b66-a63d-ac3b1cc474f8"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:44Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm","msg":"Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"6379eed2-9aab-459a-85e6-88dc15c5c090","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"reconcile","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"apply","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.initialize"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.createDefaultGroup"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/auth.managePermissions"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:44Z","msg":"Executing action","controller":"auth","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Auth","Auth":{"name":"auth"},"namespace":"","name":"auth","reconcileID":"ed8ee093-0132-4727-9a81-b6cd48e2faa2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"0cca607c-6f4b-4301-a803-0a6fe4aa1662","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"eafacee6-f3d7-4778-a869-b01f11d7aba8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"14c56225-3ad2-4187-8007-f9e55f5cf703","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"14c56225-3ad2-4187-8007-f9e55f5cf703","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1cfc15b-227c-4e46-a6af-bf8fe6aca4c5","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c880511e-6f5d-45f0-81dc-259e6a78b802","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"c880511e-6f5d-45f0-81dc-259e6a78b802","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:04Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"4b77458e-1920-4c91-ba77-11def2de333a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"258980c2-f395-492c-a7f9-2cdeea785d9d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"42da41cd-5731-4cca-88f0-e6e6e9ff3d5f","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"42da41cd-5731-4cca-88f0-e6e6e9ff3d5f","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"0da2845b-a7c4-43ac-b2c0-17e52d9bd1c6","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:05Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"78b60767-3db3-4313-bea2-7afab71b18f8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"6f9e8575-52de-49a1-a608-fb3ec55d1c44","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:03:07Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6273f5d7-c1e2-408d-8fb2-ebc5b57635fd","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6273f5d7-c1e2-408d-8fb2-ebc5b57635fd","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c59d3e41-c565-436f-8506-44d6c2e2d166","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:07Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d160532c-c77b-416e-b5ef-14ed08d390f2","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:03:07Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"d160532c-c77b-416e-b5ef-14ed08d390f2","name":"redhat-ods-applications"} {"level":"error","ts":"2026-07-19T06:03:07Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:03:08Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"7e0e45de-ddbd-4f16-8bb9-d38c88dcba3a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:03:19Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"openldap","reconcileID":"d6a3dd7e-8af9-4bd0-86f3-79be0990cffe"} {"level":"info","ts":"2026-07-19T06:03:19Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"openldap","reconcileID":"6cdefb86-9692-4bd6-8c06-e5465f9910ba"} {"level":"info","ts":"2026-07-19T06:03:19Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"openldap","reconcileID":"f90cef1e-068d-4367-b02e-f9e4bd14be9d"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:03:38Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:03:38Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"10c4eced-f041-4eb7-bc06-8122d47ed17a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:03:47Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:04:32Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:05:08Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:05:08Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"071b1fa5-2eec-41c9-bdad-f4309599bda8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:05:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:05:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"60f7e0aa-d2c4-42cb-ae99-364b6d375d6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:05:23Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:05:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-kserve-raw-token-authentication","reconcileID":"ca55cd69-91dd-4273-b3b6-5a9308149327"} {"level":"info","ts":"2026-07-19T06:05:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-kserve-raw-token-authentication","reconcileID":"22dcc7f1-3b04-4301-8462-0f3294935126"} {"level":"info","ts":"2026-07-19T06:05:36Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-kserve-raw-token-authentication","reconcileID":"6300e85c-b060-48e3-a6ef-3e5e3923174a"} {"level":"error","ts":"2026-07-19T06:06:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:06:23Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:06:23Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"2e28d67c-0cac-4430-acdf-2cdf7c547fe8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:07:04Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-non-admin-raw","reconcileID":"1fa933da-010e-4bcd-95e3-b5379718ec81"} {"level":"info","ts":"2026-07-19T06:07:04Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-non-admin-raw","reconcileID":"21d872e8-0bf4-46fd-a8f4-88a1dfd625cf"} {"level":"info","ts":"2026-07-19T06:07:05Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"test-non-admin-raw","reconcileID":"2b692b13-dcd7-4b74-ab54-45bdd0ee6fb2"} {"level":"error","ts":"2026-07-19T06:07:08Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:07:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:08:04Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"onnx-standard-rest","reconcileID":"01d6e23e-53de-4c4a-91c4-eb7ca846b25c"} {"level":"info","ts":"2026-07-19T06:08:04Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"onnx-standard-rest","reconcileID":"3e8e1c07-252d-46e1-977f-76c840f17bf2"} {"level":"info","ts":"2026-07-19T06:08:04Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"onnx-standard-rest","reconcileID":"30485b95-b785-4921-a108-6cc2aada7527"} {"level":"info","ts":"2026-07-19T06:08:23Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ovms-smoke","reconcileID":"817fc7b2-1bd7-4315-8c0b-99c6bc58ce97"} {"level":"info","ts":"2026-07-19T06:08:23Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ovms-smoke","reconcileID":"140af383-fbf5-4633-9b4d-fe6215b6b6e3"} {"level":"info","ts":"2026-07-19T06:08:23Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ovms-smoke","reconcileID":"933ec1d9-0ffe-4bec-b688-626a19255451"} {"level":"error","ts":"2026-07-19T06:08:32Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:09:00Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"tensorflow-standard","reconcileID":"2e706cdb-a403-418c-9a5f-7a1b70c112d0"} {"level":"info","ts":"2026-07-19T06:09:00Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"tensorflow-standard","reconcileID":"605d5cc9-3321-4d69-916a-c538bcf8e40f"} {"level":"info","ts":"2026-07-19T06:09:00Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"tensorflow-standard","reconcileID":"71509937-4ec2-458b-a236-1bca2b99fb6d"} {"level":"error","ts":"2026-07-19T06:09:31Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:10:01Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:10:38Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:11:35Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:11:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:11:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm","msg":"EnvoyFilter exposes internal implementation details that may change at any time. Prefer other APIs if possible, and exercise extreme caution, especially around upgrades.","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:11:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9f377bd-4f7a-4e7d-a829-e8d31bbeb3f0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:11:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:11:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"15283a3b-8d39-4cac-9a84-e89483392ac7","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:12:15Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:12:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:12:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0b1ed69d-ebf8-4620-a837-c513e40e7a36","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:12:52Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:12:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:12:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"a1c83f43-0459-40db-b303-97c820ae8b6c","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:13:09Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:13:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"df7d9ca4-a926-465b-b876-de547a84c891","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:13:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"tensorflow-standard","reconcileID":"b1663af4-960a-41a5-b535-6dcd581e9128"} {"level":"info","ts":"2026-07-19T06:13:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"tensorflow-standard","reconcileID":"54b9bf58-4d20-483d-aa58-028406e73011"} {"level":"info","ts":"2026-07-19T06:13:13Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"tensorflow-standard","reconcileID":"8df49f30-fd74-4e95-8a20-50926abfd7d2"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:13:24Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:13:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"1863ee4f-32c1-42d1-b0f6-336caf82a977","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:13:34Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:14:18Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:15:09Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:09Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c65c4c20-ef79-4d30-96d6-7a9da235799d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:15:17Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:15:24Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:24Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"0e19eab2-69d5-43bd-9bee-eb25bcdf26ca","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:15:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:15:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"3b9da215-fb05-4598-a183-8574de17e9f2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:16:08Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:16:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:16:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"14dd555c-2a8d-4042-96a5-5feb7519dca9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:17:02Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:17:47Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"error","ts":"2026-07-19T06:18:28Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:18:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:18:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"31a15b86-08a0-468d-ae2e-48f2a4ee227f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:18:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:18:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"b5f82b43-ab71-46cc-9d95-0951cd5b6280","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:19:07Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:19:39Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:19:39Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"c9561610-bfe1-4919-b3f5-aa14376fb4b2","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:19:46Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ai-tenant-e2e-aigw-f978966b","reconcileID":"fc439315-ee4e-48bb-b127-fd5e5c7b50c5"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ai-tenant-e2e-aigw-f978966b","reconcileID":"b1c1a1f1-fb2f-4c12-a22d-d6eac61aec85"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Adding CA bundle configmap","controller":"cert-configmap-generator-controller","namespace":"","name":"ai-tenant-e2e-aigw-f978966b","reconcileID":"d1fbce98-aba5-43ab-8868-f2efb1a1485a"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"1699a772-819c-4cf1-a919-87a96937da77","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"c6342239-0d91-49a3-9b20-2704f9c70bb1","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9e77d480-0e67-4a70-ab80-af4487928e5a","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"9e77d480-0e67-4a70-ab80-af4487928e5a","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"edea74aa-02f7-496b-a3ca-1f46cbc5cf15","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"46aa4dca-ae8a-4723-bec7-f135c1c08d7e","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"e74407cc-f022-414b-833f-97925466b1a8","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"00e0e05b-d167-4453-a2dc-32ac2eaaeba3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"reconcile","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"apply","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.initialize"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.checkPreConditions"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.updateStatus"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/datasciencecluster.provisionComponents"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d3a54f49-e7a2-43ef-8b35-dac510b01b6d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"datasciencecluster","controllerGroup":"datasciencecluster.opendatahub.io","controllerKind":"DataScienceCluster","DataScienceCluster":{"name":"default-dsc"},"namespace":"","name":"default-dsc","reconcileID":"b0beaa19-bd80-4444-b2ef-bbcd3187c53f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"42519704-c2c9-4460-90d7-7ae59884e33d","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"42519704-c2c9-4460-90d7-7ae59884e33d","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"db203b53-e214-483e-896a-27ba1d83a91f","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"5189c257-31f7-4ff4-8148-129f1cab36a4","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"9092afa6-7528-4758-af1b-26a94a622140","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:08Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6c9102fa-188d-4321-956a-cd100f4a2c1b","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"6c9102fa-188d-4321-956a-cd100f4a2c1b","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"f1192ff0-da6d-4554-aa1f-db9ad35a6b6a","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:08Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"48d3d32c-62d3-4ccd-aae0-41af6918c129","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"ef9024ab-3491-464a-9e58-348bc5054cf0","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","logger":"DSCInitialization","msg":"Reconciling DSCInitialization.","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0a7c5bd1-31a1-4cc7-93e7-5cab346bdbd2","DSCInitialization Request.Name":"default-dsci"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Application namespace set in DSCI not found, creating it with labels","controller":"dscinitialization","controllerGroup":"dscinitialization.opendatahub.io","controllerKind":"DSCInitialization","DSCInitialization":{"name":"default-dsci"},"namespace":"","name":"default-dsci","reconcileID":"0a7c5bd1-31a1-4cc7-93e7-5cab346bdbd2","name":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"60c051fc-b94a-49a9-ba0c-58e162eb7a0d","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"05a52ced-0928-4431-83d5-4ceead7323e9","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"reconcile","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"apply","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/status/deployments.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.addMonitoringCapability"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringAdmissionPolicies"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployMonitoringStackWithQuerierAndRestrictions"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployTracingStack"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployAlerting"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployOpenTelemetryCollector"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPerses"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesTempoIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployPersesPrometheusIntegration"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.deployNodeMetricsEndpoint"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/monitoring.syncPrometheusWebTLSCA"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:09Z","msg":"Executing action","controller":"monitoring","controllerGroup":"services.platform.opendatahub.io","controllerKind":"Monitoring","Monitoring":{"name":"default-monitoring"},"namespace":"","name":"default-monitoring","reconcileID":"d509b4c1-6927-4cad-b80b-251d441d1890","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:20:19Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"reconcile","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"apply","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createGatewayInfrastructure"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createKubeAuthProxyInfrastructure"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createEnvoyFilter"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createNetworkPolicy"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createOCPRoutes"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects"} {"level":"info","ts":"2026-07-19T06:20:54Z","logger":"action.github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.createDashboardRedirects.createDashboardRedirects","msg":"Creating dashboard redirect resources","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","dashboardRouteName":"rhods-dashboard","namespace":"redhat-ods-applications","currentSubdomain":"rh-ai"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/render/template.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/deploy.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/internal/controller/services/gateway.syncGatewayConfigStatus"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/actions/gc.(*Action).run-fm"} {"level":"info","ts":"2026-07-19T06:20:54Z","msg":"Executing action","controller":"gatewayconfig","controllerGroup":"services.platform.opendatahub.io","controllerKind":"GatewayConfig","GatewayConfig":{"name":"default-gateway"},"namespace":"","name":"default-gateway","reconcileID":"d4340cb6-a2c6-421b-b21b-9ee83f40d7a3","action":"github.com/opendatahub-io/opendatahub-operator/v2/pkg/controller/reconciler.(*dynamicWatchAction).run-fm"} {"level":"error","ts":"2026-07-19T06:21:04Z","logger":"controller-runtime.cache.UnhandledError","msg":"Failed to watch","reflector":"pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:289","type":"operator.authorino.kuadrant.io/v1beta1, Kind=Authorino","error":"authorinos.operator.authorino.kuadrant.io is forbidden: User \"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager\" cannot watch resource \"authorinos\" in API group \"operator.authorino.kuadrant.io\" at the cluster scope","stacktrace":"k8s.io/apimachinery/pkg/util/runtime.logError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:221\nk8s.io/apimachinery/pkg/util/runtime.handleError\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:212\nk8s.io/apimachinery/pkg/util/runtime.HandleErrorWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/runtime/runtime.go:198\nk8s.io/client-go/tools/cache.DefaultWatchErrorHandler\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:204\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:370\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:255\nk8s.io/apimachinery/pkg/util/wait.BackoffUntilWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:256\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:233\nk8s.io/client-go/tools/cache.(*Reflector).RunWithContext\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.35.3/tools/cache/reflector.go:368\nk8s.io/client-go/tools/cache.(*controller).RunWithContext.(*Group).StartWithContext.func3\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:63\nk8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1\n\t/cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:72"} ==================== OPERATOR POD LOG: rhods-operator-5586fcc7f5-x5nnq.log ==================== {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"Cluster config","Operator Namespace":"redhat-ods-operator","Application Namespace":"redhat-ods-applications","Release":{"name":"OpenShift AI Self-Managed","version":"3.5.0-ea.2"},"Cluster":{"type":"OpenShift","version":"4.21.25"}} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"datasciencecluster.opendatahub.io/v1, Kind=DataScienceCluster"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-datasciencecluster-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"dscinitialization.opendatahub.io/v1, Kind=DSCInitialization"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v1"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dscinitialization-v2"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-hardware-profile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-prometheus-monitors"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-isvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-llmisvc"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/platform-connection-notebook"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-acceleratorprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-dashboard-hardwareprofile"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"gateway"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"monitoring"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"setupcontroller"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"auth"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"service","name":"certconfigmapgenerator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"workbenches"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"mlflowoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trustyai"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"datasciencepipelines"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelsasservice"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ogx"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainer"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"feastoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"sparkoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"dashboard"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelcontroller"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"trainingoperator"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"ray"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kserve"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"kueue"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"creating reconciler","type":"component","name":"modelregistry"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-19T05:46:21Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"0.0.0.0:8080","secure":false} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"setup","msg":"Attempting to acquire leader lease...","lock":"redhat-ods-operator/07ed84f7.opendatahub.io"} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:46:21Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} ==================== WORKLOAD POD LOG: redhat-ods-applications/dashboard-redirect-6d9cf976b5-5wh7t.log ==================== 2026/07/19 05:46:47 [notice] 1#1: using the "epoll" event method 2026/07/19 05:46:47 [notice] 1#1: nginx/1.26.3 2026/07/19 05:46:47 [notice] 1#1: built by gcc 11.5.0 20240719 (Red Hat 11.5.0-14) (GCC) 2026/07/19 05:46:47 [notice] 1#1: OS: Linux 5.14.0-570.128.1.el9_6.x86_64 2026/07/19 05:46:47 [notice] 1#1: getrlimit(RLIMIT_NOFILE): 1024:524288 2026/07/19 05:46:47 [notice] 1#1: start worker processes 2026/07/19 05:46:47 [notice] 1#1: start worker process 12 2026/07/19 05:46:47 [notice] 1#1: start worker process 13 ==================== WORKLOAD POD LOG: redhat-ods-applications/kserve-controller-manager-dd9f6cf9-ndjl7.log ==================== {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up client for manager"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up manager"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Registering Components."} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up controller schemes"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up v1beta1 controller"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"v1beta1Controllers.InferenceService","msg":"The InferenceService controller won't watch serving.knative.dev/v1/Service resources because the CRD is not available."} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"v1beta1Controllers.InferenceService","msg":"The InferenceService controller won't watch opentelemetry-collector resources because the CRD is not available."} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"v1beta1Controllers.InferenceService","msg":"The InferenceService controller won't watch serving.kserve.io/v1alpha1/ClusterServingRuntime resources because the CRD is not available."} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up v1beta1 TrainedModel controller"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up InferenceGraph controller"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"v1alpha1Controllers.InferenceGraph","msg":"The InferenceGraph controller won't watch serving.knative.dev/v1/Service resources because the CRD is not available."} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"setting up webhook server"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"registering webhooks to the webhook server"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-pods"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"registering serving runtime validator webhook to the webhook server"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-servingruntime"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=TrainedModel","path":"/validate-serving-kserve-io-v1alpha1-trainedmodel"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-trainedmodel"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=InferenceGraph","path":"/validate-serving-kserve-io-v1alpha1-inferencegraph"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-inferencegraph"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a mutating webhook","GVK":"serving.kserve.io/v1beta1, Kind=InferenceService","path":"/mutate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1beta1, Kind=InferenceService","path":"/validate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1beta1-inferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Starting the Cmd."} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"127.0.0.1:8080","secure":false} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} I0719 05:47:08.669634 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/kserve-controller-manager-leader-lock... I0719 05:47:08.677449 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/kserve-controller-manager-leader-lock {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Pod"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","source":"kind source: *v1.Route"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"trainedmodel","controllerGroup":"serving.kserve.io","controllerKind":"TrainedModel","source":"kind source: *v1alpha1.TrainedModel"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1beta1.InferenceService"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","source":"kind source: *v1alpha1.InferenceGraph"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Deployment"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","source":"kind source: *v1.Deployment"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1alpha1.ScaledObject"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1beta1.VirtualService"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1.Ingress"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting EventSource","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","source":"kind source: *v1alpha1.ServingRuntime"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting Controller","controller":"trainedmodel","controllerGroup":"serving.kserve.io","controllerKind":"TrainedModel"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting workers","controller":"trainedmodel","controllerGroup":"serving.kserve.io","controllerKind":"TrainedModel","worker count":1} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting Controller","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting workers","controller":"inferencegraph","controllerGroup":"serving.kserve.io","controllerKind":"InferenceGraph","worker count":1} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting Controller","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"Starting workers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","worker count":1} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa"}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate create","name":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","msg":"metadata.finalizers: \"inferenceservice.finalizers\": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"},"namespace":"test-kserve-raw-token-authentication","name":"http-onnx","reconcileID":"e8cbc714-05ba-49d7-9ccc-ef3d97c23d81"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:36Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"error","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Failed to update InferenceService status","InferenceService":"http-onnx","error":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:428\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:380\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Error updating status after ingress reconcile failure","error":"fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx\": the object has been modified; please apply your changes to the latest version and try again","errorVerbose":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx\": the object has been modified; please apply your changes to the latest version and try again\nfails to update InferenceService status\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:431\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:380\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:381\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:05:37Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"},"namespace":"test-kserve-raw-token-authentication","name":"http-onnx","reconcileID":"e8cbc714-05ba-49d7-9ccc-ef3d97c23d81","error":"fails to reconcile ingress: Route.route.openshift.io \"http-onnx\" not found","errorVerbose":"Route.route.openshift.io \"http-onnx\" not found\nfails to reconcile ingress\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:383\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:41Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:20Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"Deployment Updated","Diff":" v1.DeploymentSpec{\n \t... // 1 ignored field\n \tSelector: &{MatchLabels: {\"app\": \"isvc.http-onnx-predictor\"}},\n \tTemplate: v1.PodTemplateSpec{\n \t\tObjectMeta: v1.ObjectMeta{\n \t\t\t... // 9 identical fields\n \t\t\tDeletionGracePeriodSeconds: nil,\n \t\t\tLabels: {\"app\": \"isvc.http-onnx-predictor\", \"component\": \"predictor\", \"networking.kserve.io/visibility\": \"exposed\", \"serving.kserve.io/inferenceservice\": \"http-onnx\"},\n \t\t\tAnnotations: map[string]string{\n \t\t\t\t... // 4 identical entries\n \t\t\t\t\"prometheus.io/path\": \"/metrics\",\n \t\t\t\t\"prometheus.io/port\": \"8888\",\n- \t\t\t\t\"security.opendatahub.io/enable-auth\": \"true\",\n+ \t\t\t\t\"security.opendatahub.io/enable-auth\": \"false\",\n \t\t\t\t\"service.beta.openshift.io/serving-cert-secret-name\": \"http-onnx-predictor-serving-cert\",\n \t\t\t\t\"serving.kserve.io/deploymentMode\": \"Standard\",\n \t\t\t},\n \t\t\tOwnerReferences: nil,\n \t\t\tFinalizers: nil,\n \t\t\tManagedFields: nil,\n \t\t},\n \t\tSpec: {Volumes: {{Name: \"proxy-tls\", VolumeSource: {Secret: &{SecretName: \"http-onnx-predictor-serving-cert\", DefaultMode: &420}}}, {Name: \"kube-rbac-proxy-sar-config\", VolumeSource: {ConfigMap: &{LocalObjectReference: {Name: \"http-onnx-kube-rbac-proxy-sar-config\"}, DefaultMode: &420}}}}, Containers: {{Name: \"kserve-container\", Image: \"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:\"..., Args: {\"--model_name=http-onnx\", \"--port=8001\", \"--rest_port=8888\", \"--model_path=/mnt/models\", ...}, Ports: {{ContainerPort: 8888, Protocol: \"TCP\"}}, ...}, {Name: \"kube-rbac-proxy\", Image: \"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e\"..., Args: {\"--secure-listen-address=:8443\", \"--proxy-endpoints-port=8643\", \"--upstream=http://localhost:8888\", \"--auth-header-fields-enabled=true\", ...}, Ports: {{Name: \"https\", ContainerPort: 8443, Protocol: \"TCP\"}, {Name: \"proxy\", ContainerPort: 8643, Protocol: \"TCP\"}}, ...}}, RestartPolicy: \"Always\", TerminationGracePeriodSeconds: &30, ...},\n \t},\n \tStrategy: {Type: \"RollingUpdate\", RollingUpdate: &{MaxUnavailable: &{Type: 1, StrVal: \"25%\"}, MaxSurge: &{Type: 1, StrVal: \"25%\"}}},\n \tMinReadySeconds: 0,\n \t... // 3 identical fields\n }\n"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:28Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:30Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:31Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"DeploymentReconciler","msg":"Deployment Updated","Diff":" v1.DeploymentSpec{\n \t... // 1 ignored field\n \tSelector: &{MatchLabels: {\"app\": \"isvc.http-onnx-predictor\"}},\n \tTemplate: v1.PodTemplateSpec{\n \t\tObjectMeta: v1.ObjectMeta{\n \t\t\t... // 9 identical fields\n \t\t\tDeletionGracePeriodSeconds: nil,\n \t\t\tLabels: {\"app\": \"isvc.http-onnx-predictor\", \"component\": \"predictor\", \"networking.kserve.io/visibility\": \"exposed\", \"serving.kserve.io/inferenceservice\": \"http-onnx\"},\n \t\t\tAnnotations: map[string]string{\n \t\t\t\t... // 4 identical entries\n \t\t\t\t\"prometheus.io/path\": \"/metrics\",\n \t\t\t\t\"prometheus.io/port\": \"8888\",\n- \t\t\t\t\"security.opendatahub.io/enable-auth\": \"false\",\n+ \t\t\t\t\"security.opendatahub.io/enable-auth\": \"true\",\n \t\t\t\t\"service.beta.openshift.io/serving-cert-secret-name\": \"http-onnx-predictor-serving-cert\",\n \t\t\t\t\"serving.kserve.io/deploymentMode\": \"Standard\",\n \t\t\t},\n \t\t\tOwnerReferences: nil,\n \t\t\tFinalizers: nil,\n \t\t\tManagedFields: nil,\n \t\t},\n \t\tSpec: {Volumes: {{Name: \"proxy-tls\", VolumeSource: {Secret: &{SecretName: \"http-onnx-predictor-serving-cert\", DefaultMode: &420}}}, {Name: \"kube-rbac-proxy-sar-config\", VolumeSource: {ConfigMap: &{LocalObjectReference: {Name: \"http-onnx-kube-rbac-proxy-sar-config\"}, DefaultMode: &420}}}}, Containers: {{Name: \"kserve-container\", Image: \"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:\"..., Args: {\"--model_name=http-onnx\", \"--port=8001\", \"--rest_port=8888\", \"--model_path=/mnt/models\", ...}, Ports: {{ContainerPort: 8888, Protocol: \"TCP\"}}, ...}, {Name: \"kube-rbac-proxy\", Image: \"registry.redhat.io/rhoai/odh-kube-rbac-proxy-rhel9@sha256:1e614e\"..., Args: {\"--secure-listen-address=:8443\", \"--proxy-endpoints-port=8643\", \"--upstream=http://localhost:8888\", \"--auth-header-fields-enabled=true\", ...}, Ports: {{Name: \"https\", ContainerPort: 8443, Protocol: \"TCP\"}, {Name: \"proxy\", ContainerPort: 8643, Protocol: \"TCP\"}}, ...}}, RestartPolicy: \"Always\", TerminationGracePeriodSeconds: &30, ...},\n \t},\n \tStrategy: {Type: \"RollingUpdate\", RollingUpdate: &{MaxUnavailable: &{Type: 1, StrVal: \"25%\"}, MaxSurge: &{Type: 1, StrVal: \"25%\"}}},\n \tMinReadySeconds: 0,\n \t... // 3 identical fields\n }\n"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx"}],"resources":{}}],"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:33Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2"}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate create","name":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","msg":"metadata.finalizers: \"inferenceservice.finalizers\": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"},"namespace":"test-kserve-raw-token-authentication","name":"http-onnx-2","reconcileID":"3d759135-1c36-4e0c-81a0-0217eb6f1dc1"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"error","ts":"2026-07-19T06:06:35Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"},"namespace":"test-kserve-raw-token-authentication","name":"http-onnx-2","reconcileID":"3d759135-1c36-4e0c-81a0-0217eb6f1dc1","error":"fails to reconcile ingress: Route.route.openshift.io \"http-onnx-2\" not found","errorVerbose":"Route.route.openshift.io \"http-onnx-2\" not found\nfails to reconcile ingress\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:383\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"error","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Failed to update InferenceService status","InferenceService":"http-onnx-2","error":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx-2\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:428\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:380\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Error updating status after ingress reconcile failure","error":"fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx-2\": the object has been modified; please apply your changes to the latest version and try again","errorVerbose":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx-2\": the object has been modified; please apply your changes to the latest version and try again\nfails to update InferenceService status\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:431\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:380\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:381\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:06:35Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"},"namespace":"test-kserve-raw-token-authentication","name":"http-onnx-2","reconcileID":"7c48a3a6-4e70-4d35-ade0-0d71962fb722","error":"fails to reconcile ingress: Route.route.openshift.io \"http-onnx-2\" not found","errorVerbose":"Route.route.openshift.io \"http-onnx-2\" not found\nfails to reconcile ingress\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:383\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:35Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:36Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:38Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-kserve-raw-token-authentication"} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-2","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-2"}],"resources":{}}],"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:06:47Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:56Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:56Z","logger":"v1beta1Controllers.InferenceService","msg":"Deleting external resources","InferenceService":"http-onnx-2"} {"level":"info","ts":"2026-07-19T06:06:56Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:56Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:56Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:56Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:56Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa-2","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:57Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:57Z","logger":"v1beta1Controllers.InferenceService","msg":"Deleting external resources","InferenceService":"http-onnx"} {"level":"info","ts":"2026-07-19T06:06:57Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:57Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:06:57Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:06:57Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-kserve-raw-token-authentication","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-secret"}},"serviceAccountName":"models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}}}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate create","name":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","msg":"metadata.finalizers: \"inferenceservice.finalizers\": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx-raw","namespace":"test-non-admin-raw"},"namespace":"test-non-admin-raw","name":"http-onnx-raw","reconcileID":"9fa42f26-629b-4611-83c9-2eb2bafad21a"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"error","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Failed to update InferenceService status","InferenceService":"http-onnx-raw","error":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx-raw\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:428\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:07:04Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx-raw","namespace":"test-non-admin-raw"},"namespace":"test-non-admin-raw","name":"http-onnx-raw","reconcileID":"9fa42f26-629b-4611-83c9-2eb2bafad21a","error":"fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx-raw\": the object has been modified; please apply your changes to the latest version and try again","errorVerbose":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"http-onnx-raw\": the object has been modified; please apply your changes to the latest version and try again\nfails to update InferenceService status\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:431\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","msg":"metadata.finalizers: \"inferenceservice.finalizers\": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"http-onnx-raw","namespace":"test-non-admin-raw"},"namespace":"test-non-admin-raw","name":"http-onnx-raw","reconcileID":"331d580e-25c2-486c-b3ba-7687a7193590"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:06Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"http-onnx-raw","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"test-non-admin-raw"} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=http-onnx-raw","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"http-onnx-raw"}],"resources":{}}],"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:07:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Deleting external resources","InferenceService":"http-onnx-raw"} {"level":"info","ts":"2026-07-19T06:07:26Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:07:26Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:26Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:07:26Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"test-non-admin-raw","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"http-mnist-runtime","name":"","resources":{},"storage":{"path":"/test-dir/","key":"ci-bucket-unprivileged"}},"automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate create","name":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","msg":"metadata.finalizers: \"inferenceservice.finalizers\": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"onnx","namespace":"onnx-standard-rest"},"namespace":"onnx-standard-rest","name":"onnx","reconcileID":"5739cc30-9b4d-491a-ba08-dbc1fc8445fe"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"CredentialBuilder","msg":"found secret","SecretName":"models-bucket-secret"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"CredentialBuilder","msg":"Setting secret envs for s3","S3Secret":"models-bucket-secret"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"CredentialBuilder","msg":"found secret","SecretName":"openvino-models-bucket-sa-dockercfg-lnk27"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"error","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Failed to update InferenceService status","InferenceService":"onnx","error":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"onnx\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:428\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:08:04Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"onnx","namespace":"onnx-standard-rest"},"namespace":"onnx-standard-rest","name":"onnx","reconcileID":"d90356e8-f714-4456-b025-18f49b68ac7d","error":"fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"onnx\": the object has been modified; please apply your changes to the latest version and try again","errorVerbose":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"onnx\": the object has been modified; please apply your changes to the latest version and try again\nfails to update InferenceService status\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:431\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:07Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"onnx","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"onnx-standard-rest"} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"registry.redhat.io/rhoai/odh-openvino-model-server-rhel9@sha256:8c1b225509bfdc43756195f34a356d1e2ebd58fcd83fda3d37380dd7f5304df8","args":["--model_name=onnx","--port=8001","--rest_port=8888","--model_path=/mnt/models","--file_system_poll_wait_seconds=0","--metrics_enable"],"ports":[{"containerPort":8888,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"onnx"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:08:15Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"onnx"} {"level":"info","ts":"2026-07-19T06:08:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Deleting external resources","InferenceService":"onnx"} {"level":"info","ts":"2026-07-19T06:08:16Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:16Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:16Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:08:16Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:08:16Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"onnx-standard-rest","isvc":{"model":{"modelFormat":{"name":"openvino_ir"},"runtime":"openvino-runtime","storageUri":"s3://mlflow-e2e/openvino/model_repository/onnx/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"openvino-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate create","name":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:00Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:01Z","msg":"metadata.finalizers: \"inferenceservice.finalizers\": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"},"namespace":"tensorflow-standard","name":"tensorflow-standard-grpc","reconcileID":"908de90e-4771-4e1d-858d-6a645fd71c58"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CredentialBuilder","msg":"found secret","SecretName":"models-bucket-secret"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CredentialBuilder","msg":"Setting secret envs for s3","S3Secret":"models-bucket-secret"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CredentialBuilder","msg":"found secret","SecretName":"triton-models-bucket-sa-dockercfg-kv2mh"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"error","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Failed to update InferenceService status","InferenceService":"tensorflow-standard-grpc","error":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-grpc\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:428\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:09:01Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"},"namespace":"tensorflow-standard","name":"tensorflow-standard-grpc","reconcileID":"dde8da36-7f50-4545-a49e-18a3c9df8f0e","error":"fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-grpc\": the object has been modified; please apply your changes to the latest version and try again","errorVerbose":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-grpc\": the object has been modified; please apply your changes to the latest version and try again\nfails to update InferenceService status\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:431\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"error","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Failed to update InferenceService status","InferenceService":"tensorflow-standard-grpc","error":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-grpc\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:428\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:09:01Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"},"namespace":"tensorflow-standard","name":"tensorflow-standard-grpc","reconcileID":"14de4581-4554-4731-beab-985c950a8b42","error":"fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-grpc\": the object has been modified; please apply your changes to the latest version and try again","errorVerbose":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-grpc\": the object has been modified; please apply your changes to the latest version and try again\nfails to update InferenceService status\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:431\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:02Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:09:04Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-grpc","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"volumes":[{"name":"shm","emptyDir":{"medium":"Memory","sizeLimit":"2Gi"}}],"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--grpc-port=9000","--allow-grpc=True"],"ports":[{"name":"h2c","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-grpc"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}},"volumeMounts":[{"name":"shm","mountPath":"/dev/shm"}]}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:01Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:13:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Deleting external resources","InferenceService":"tensorflow-standard-grpc"} {"level":"info","ts":"2026-07-19T06:13:05Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:05Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:05Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:05Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:05Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-grpc-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate create","name":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","msg":"metadata.finalizers: \"inferenceservice.finalizers\": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"},"namespace":"tensorflow-standard","name":"tensorflow-standard-rest","reconcileID":"adcf18e4-a44f-449e-8dca-ff633dbaa0d4"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":0,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CredentialBuilder","msg":"found secret","SecretName":"models-bucket-secret"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CredentialBuilder","msg":"Setting secret envs for s3","S3Secret":"models-bucket-secret"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CredentialBuilder","msg":"found secret","SecretName":"triton-models-bucket-sa-dockercfg-cfjm5"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"validate update","name":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"inferenceservice-v1beta1-validation-webhook","msg":"Incoming predictor struct","predictor":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"error","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Failed to update InferenceService status","InferenceService":"tensorflow-standard-rest","error":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-rest\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:428\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"error","ts":"2026-07-19T06:13:13Z","msg":"Reconciler error","controller":"inferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"InferenceService","InferenceService":{"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"},"namespace":"tensorflow-standard","name":"tensorflow-standard-rest","reconcileID":"8db6fc8f-425f-4778-b7f1-25a6d2e2c22b","error":"fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-rest\": the object has been modified; please apply your changes to the latest version and try again","errorVerbose":"Operation cannot be fulfilled on inferenceservices.serving.kserve.io \"tensorflow-standard-rest\": the object has been modified; please apply your changes to the latest version and try again\nfails to update InferenceService status\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).updateStatus\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:431\ngithub.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice.(*InferenceServiceReconciler).Reconcile\n\t/go/src/github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/controller.go:402\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:216\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:461\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1693","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:474\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:421\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.22.5/pkg/internal/controller/controller.go:296"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"kserve-pod-mutator-webhook","msg":"The Inference Service does not contain a logging spec. The global ConfigMap will be used as the logger configuration","name":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"kserve-pod-mutator-webhook","msg":"getLoggerConfig processing configuration","loggerConfig":{"image":"registry.redhat.io/rhoai/odh-kserve-agent-rhel9@sha256:22624819998af78cce29b57772463b810d1a881b8f9a76d3c74e224c77da004e","cpuRequest":"100m","cpuLimit":"1","memoryRequest":"100Mi","memoryLimit":"1Gi","defaultUrl":"http://default-broker","caBundle":"","caCertFile":"","tlsSkipVerify":false,"storage":null}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:14Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:17Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling inference service","apiVersion":"serving.kserve.io/v1beta1","isvc":"tensorflow-standard-rest","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"CaBundleConfigMapReconciler","msg":"Reconciling CaBundleConfigMap","namespace":"tensorflow-standard"} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"PredictorReconciler","msg":"Resolved container","container":"nil","podSpec":{"containers":[{"name":"kserve-container","image":"nvcr.io/nvidia/tritonserver:25.02-py3","args":["tritonserver","--model-store=/mnt/models","--http-port=8080","--allow-http=True"],"ports":[{"name":"http1","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"INFERENCE_SERVICE_NAME","value":"tensorflow-standard-rest"}],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}}],"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false}} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"ServiceReconciler","msg":"service reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"DeploymentReconciler","msg":"deployment reconcile","checkResult":2,"err":null} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"HPAReconciler","msg":"HorizontalPodAutoscaler reconcile","checkResult":1,"err":null} {"level":"info","ts":"2026-07-19T06:13:26Z","logger":"v1beta1Controllers.InferenceService","msg":"Reconciling ingress for inference service","isvc":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Deleting external resources","InferenceService":"tensorflow-standard-rest"} {"level":"info","ts":"2026-07-19T06:13:37Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:37Z","logger":"v1beta1Controllers.InferenceService","msg":"Inference service deployment mode ","deployment mode ":"Standard"} {"level":"info","ts":"2026-07-19T06:13:37Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:37Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} {"level":"info","ts":"2026-07-19T06:13:37Z","logger":"inferenceservice-v1beta1-mutating-webhook","msg":"Defaulting InferenceService","namespace":"tensorflow-standard","isvc":{"model":{"modelFormat":{"name":"tensorrt"},"runtime":"triton-rest-runtime","storageUri":"s3://mlflow-e2e/triton/model_repository/","name":"","resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"1","memory":"2Gi"}}},"serviceAccountName":"triton-models-bucket-sa","automountServiceAccountToken":false,"minReplicas":1}} ==================== WORKLOAD POD LOG: redhat-ods-applications/llmisvc-controller-manager-7b46b9fbbb-2vvcq.log ==================== {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up client for manager"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService","path":"/validate-serving-kserve-io-v1alpha2-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha2-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/convert"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceService","path":"/validate-serving-kserve-io-v1alpha1-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceServiceConfig","path":"/validate-serving-kserve-io-v1alpha1-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha1-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig","path":"/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"Setting up LLMInferenceService controller"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a mutating webhook","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceService","path":"/mutate-serving-kserve-io-v1alpha1-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-serving-kserve-io-v1alpha1-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha1, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Registering a mutating webhook","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService","path":"/mutate-serving-kserve-io-v1alpha2-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-serving-kserve-io-v1alpha2-llminferenceservice"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceService"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.builder","msg":"Conversion webhook enabled","GVK":"serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"disabling http/2"} {"level":"info","ts":"2026-07-19T05:47:08Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"setup","msg":"disabling http/2"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key"} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T05:47:08Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","cert":"/tmp/k8s-webhook-server/serving-certs/tls.crt","key":"/tmp/k8s-webhook-server/serving-certs/tls.key","interval":10} I0719 05:47:08.848638 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/llminferenceservice-kserve-controller-manager... I0719 05:47:09.046250 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/llminferenceservice-kserve-controller-manager {"level":"info","ts":"2026-07-19T05:47:09Z","logger":"setup","msg":"running storage version migration","timeout":3600,"pollInterval":30} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha2pool.InferencePool"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha2.LLMInferenceService"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Ingress"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Deployment"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Secret"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Service"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v2.HorizontalPodAutoscaler"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.DestinationRule"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.HTTPRoute"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.InferencePool"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha2pool.InferencePool"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha1.ScaledObject"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.LeaderWorkerSet"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.PodMonitor"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.ServiceMonitor"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.ResourceClaimTemplate"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1alpha2.LLMInferenceServiceConfig"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.ConfigMap"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.ConfigMap"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Pod"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.HTTPRoute"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.Gateway"} {"level":"info","ts":"2026-07-19T05:47:09Z","msg":"Starting EventSource","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","source":"kind source: *v1.InferencePool"} {"level":"info","ts":"2026-07-19T05:47:10Z","msg":"Starting Controller","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService"} {"level":"info","ts":"2026-07-19T05:47:10Z","msg":"Starting workers","controller":"llminferenceservice","controllerGroup":"serving.kserve.io","controllerKind":"LLMInferenceService","worker count":1} {"level":"info","ts":"2026-07-19T05:47:10Z","logger":"setup","msg":"storage version migration completed"} {"level":"info","ts":"2026-07-19T05:47:12Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":"127.0.0.1:8443","secure":true} {"level":"info","ts":"2026-07-19T05:47:39Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-decode-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"7507852c-4904-4bf3-b329-27ec2a53c753","name":"v3-5-0-ea-2-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:39Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"66bdc82f-a7b5-4c99-8807-66c4dc2f1450","name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:39Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"99a851c7-78bd-4d3d-abc4-0225f5006fda","name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:39Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"cb2b91a5-f297-4f28-9fe6-1433bcacd76e","name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-router-route","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-router-route","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"2a23c4d4-9374-4337-adc0-1dd71bfa2bcf","name":"v3-5-0-ea-2-kserve-config-llm-router-route","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-scheduler","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"cdce82b0-db4b-46c2-88c8-b5c2d1015306","name":"v3-5-0-ea-2-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"273796b2-b6b0-471c-ac07-b5012cdc4152","name":"v3-5-0-ea-2-kserve-config-llm-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"01bcbab0-9cda-475a-96c5-88b51935eac6","name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"42778c19-5c6b-4f13-8601-863bb0f55524","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"2bb4017f-acbc-4afe-bb3a-6e3342a671b2","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"7954f74b-8e4c-4823-b508-e816321d995f","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"e9f7911b-1176-4ed3-9837-27428d61474e","name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"acb1cf25-9aca-41f4-8efc-e59ff1658d88","name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-tracing","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-tracing","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"4577482f-11a1-4f7a-b12c-d8ee76f7597b","name":"v3-5-0-ea-2-kserve-config-llm-tracing","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T05:47:40Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"29803f04-5a26-4e5b-a6f4-2f6c99541b60","name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-decode-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"3aea30a7-bbcc-431d-b495-0f273c8b8513","name":"v3-5-0-ea-2-kserve-config-llm-decode-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"b201cc82-e506-4b51-aed5-b6ad0dce3673","name":"v3-5-0-ea-2-kserve-config-llm-decode-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"04f5831e-d636-49fc-b40d-4f352b467731","name":"v3-5-0-ea-2-kserve-config-llm-prefill-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"84a5e581-98bd-4f64-bbb1-35cbdf9fe1c7","name":"v3-5-0-ea-2-kserve-config-llm-prefill-worker-data-parallel","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-router-route","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-router-route","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"eae8708d-e158-4349-9bc1-9e5c311774cc","name":"v3-5-0-ea-2-kserve-config-llm-router-route","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-scheduler","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"253c1f8d-ddbb-45c5-97ec-ab16254e028f","name":"v3-5-0-ea-2-kserve-config-llm-scheduler","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"056af663-ad35-48da-b236-9a545d931bd9","name":"v3-5-0-ea-2-kserve-config-llm-template","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"7f632e1d-e41f-452a-bb08-c21e14afc2ba","name":"v3-5-0-ea-2-kserve-config-llm-template-amd-rocm","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"b5a13c0a-9763-4b79-ae9c-394e9e3b8822","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-ppc64le","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:58Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"0e4751d3-eafa-4c0c-b41a-f81b57c52164","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-s390x","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:59Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"0274de39-f261-41d7-b819-cdeeb34c342f","name":"v3-5-0-ea-2-kserve-config-llm-template-ibm-spyre-x86","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:59Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"8792b3c8-5990-457c-b98d-68db80a5be94","name":"v3-5-0-ea-2-kserve-config-llm-template-intel-gaudi","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:59Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"7e3ee050-be44-41c6-8954-e5625cc52227","name":"v3-5-0-ea-2-kserve-config-llm-template-nvidia-cuda","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:59Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-tracing","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-tracing","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"9bf22224-f819-418c-83cf-daab60321bd4","name":"v3-5-0-ea-2-kserve-config-llm-tracing","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:01:59Z","logger":"admission","msg":"Validating LLMInferenceServiceConfig v1alpha2","webhookGroup":"serving.kserve.io","webhookKind":"LLMInferenceServiceConfig","LLMInferenceServiceConfig":{"name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","resource":{"group":"serving.kserve.io","version":"v1alpha2","resource":"llminferenceserviceconfigs"},"user":"system:serviceaccount:redhat-ods-operator:redhat-ods-operator-controller-manager","requestID":"0c3b5169-1e1d-4e8d-999a-1a74a2475d8d","name":"v3-5-0-ea-2-kserve-config-llm-worker-data-parallel","namespace":"redhat-ods-applications"} ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-api-84dd7cc667-tttbv.log ==================== {"level":"info","timestamp":"2026-07-19T06:03:07.856Z","caller":"config/cluster_config.go:103","message":"Created MaaSModelRef informer","watchNamespace":"ALL","gvr":"maas.opendatahub.io/v1alpha1, Resource=maasmodelrefs"} {"level":"info","timestamp":"2026-07-19T06:03:07.856Z","caller":"config/cluster_config.go:110","message":"Created MaaSSubscription informer","watchNamespace":"models-as-a-service","gvr":"maas.opendatahub.io/v1alpha1, Resource=maassubscriptions"} {"level":"info","timestamp":"2026-07-19T06:03:07.856Z","caller":"cmd/main.go:66","message":"Loading database connection URL from secret..."} {"level":"info","timestamp":"2026-07-19T06:03:07.945Z","caller":"cmd/main.go:173","message":"Connecting to PostgreSQL database...","tenant":"models-as-a-service"} {"level":"info","timestamp":"2026-07-19T06:03:07.945Z","caller":"cmd/main.go:102","message":"Metrics server starting","address":":9090"} {"level":"info","timestamp":"2026-07-19T06:03:07.961Z","caller":"api_keys/db_driver.go:91","message":"Database schema applied","version":5} {"level":"info","timestamp":"2026-07-19T06:03:07.961Z","caller":"api_keys/db_driver.go:58","message":"Connected to PostgreSQL database (schema applied)","tenant":"models-as-a-service"} {"level":"info","timestamp":"2026-07-19T06:03:07.961Z","caller":"cmd/main.go:180","message":"Starting informers and waiting for cache sync..."} {"level":"info","timestamp":"2026-07-19T06:03:08.061Z","caller":"cmd/main.go:184","message":"Informer caches synced successfully"} {"level":"info","timestamp":"2026-07-19T06:03:08.067Z","caller":"cmd/main.go:202","message":"Resolved gateway internal host for access probes","host":"maas-default-gateway-openshift-default.openshift-ingress.svc.cluster.local"} {"level":"info","timestamp":"2026-07-19T06:03:08.080Z","caller":"cmd/main.go:135","message":"Server starting","address":":8443","secure":true} [GIN] 2026/07/19 - 06:03:14 | 200 | 82.528µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:19 | 200 | 31.278µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:24 | 200 | 40.202µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:29 | 200 | 33.442µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:34 | 200 | 54.794µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:37 | 200 | 34.742µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:39 | 200 | 32.669µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:44 | 200 | 34.97µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:47 | 200 | 37.125µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:49 | 200 | 33.236µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:54 | 200 | 30.77µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:57 | 200 | 34.057µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:03:59 | 200 | 53.373µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:04 | 200 | 34.53µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:07 | 200 | 33.059µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:09 | 200 | 31.341µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:14 | 200 | 34.569µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:17 | 200 | 35.766µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:19 | 200 | 33.087µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:24 | 200 | 31.649µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:27 | 200 | 32.685µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:29 | 200 | 33.732µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:34 | 200 | 32.437µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:37 | 200 | 43.661µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:39 | 200 | 32.34µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:44 | 200 | 34.792µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:47 | 200 | 32.268µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:49 | 200 | 61.073µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:54 | 200 | 32.366µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:57 | 200 | 35.628µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:04:59 | 200 | 31.137µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:04 | 200 | 35.037µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:07 | 200 | 34.408µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:09 | 200 | 30.623µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:14 | 200 | 33.494µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:17 | 200 | 38.346µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:19 | 200 | 33.104µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:24 | 200 | 31.552µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:27 | 200 | 31.663µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:29 | 200 | 36.48µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:34 | 200 | 31.584µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:37 | 200 | 40.513µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:39 | 200 | 49.76µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:44 | 200 | 37.544µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:47 | 200 | 38.828µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:49 | 200 | 48.223µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:54 | 200 | 47.862µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:57 | 200 | 44.035µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:05:59 | 200 | 41.613µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:04 | 200 | 60.607µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:07 | 200 | 48.127µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:09 | 200 | 44.118µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:14 | 200 | 38.578µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:17 | 200 | 47.966µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:19 | 200 | 40.36µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:24 | 200 | 41.723µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:27 | 200 | 42.936µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:29 | 200 | 51.127µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:34 | 200 | 39.552µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:37 | 200 | 32.465µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:39 | 200 | 31.943µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:44 | 200 | 51.75µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:47 | 200 | 53.566µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:49 | 200 | 47.936µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:54 | 200 | 39.844µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:57 | 200 | 45.473µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:06:59 | 200 | 39.647µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:04 | 200 | 44.73µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:07 | 200 | 41.559µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:09 | 200 | 38.056µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:14 | 200 | 38.313µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:17 | 200 | 38.274µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:19 | 200 | 40.802µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:24 | 200 | 40.7µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:27 | 200 | 41.744µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:29 | 200 | 36.894µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:34 | 200 | 32.017µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:37 | 200 | 34.374µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:39 | 200 | 39.439µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:44 | 200 | 35.426µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:47 | 200 | 33.043µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:49 | 200 | 31.154µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:54 | 200 | 40.812µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:57 | 200 | 36.112µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:07:59 | 200 | 31.049µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:04 | 200 | 34.472µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:07 | 200 | 31.835µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:09 | 200 | 35.869µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:14 | 200 | 33.052µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:17 | 200 | 32.636µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:19 | 200 | 32.822µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:24 | 200 | 33.634µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:27 | 200 | 36.163µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:29 | 200 | 35.032µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:34 | 200 | 33.102µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:37 | 200 | 33.96µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:39 | 200 | 47.309µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:44 | 200 | 33.121µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:47 | 200 | 56.742µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:49 | 200 | 43.329µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:54 | 200 | 34.921µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:57 | 200 | 31.841µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:08:59 | 200 | 33.297µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:04 | 200 | 31.757µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:07 | 200 | 41.045µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:09 | 200 | 40.395µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:14 | 200 | 45.272µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:17 | 200 | 45.358µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:19 | 200 | 41.073µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:24 | 200 | 41.417µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:27 | 200 | 40.888µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:29 | 200 | 44.547µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:34 | 200 | 53.566µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:37 | 200 | 50.601µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:39 | 200 | 41.477µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:44 | 200 | 70.513µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:47 | 200 | 47.315µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:49 | 200 | 44.355µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:54 | 200 | 51.269µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:57 | 200 | 40.79µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:09:59 | 200 | 42.055µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:04 | 200 | 40.536µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:07 | 200 | 42.193µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:09 | 200 | 39.519µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:14 | 200 | 40.443µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:17 | 200 | 42.53µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:19 | 200 | 44.244µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:24 | 200 | 41.252µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:27 | 200 | 42.134µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:29 | 200 | 65.372µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:34 | 200 | 37.579µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:37 | 200 | 34.884µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:39 | 200 | 46.24µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:44 | 200 | 38.064µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:47 | 200 | 40.166µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:49 | 200 | 34.471µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:54 | 200 | 43.482µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:57 | 200 | 38.88µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:10:59 | 200 | 63.056µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:04 | 200 | 32.788µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:07 | 200 | 38.053µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:09 | 200 | 33.097µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:14 | 200 | 42.8µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:17 | 200 | 35.591µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:19 | 200 | 39.503µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:24 | 200 | 40.479µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:27 | 200 | 41.602µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:29 | 200 | 32.191µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:34 | 200 | 39.637µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:37 | 200 | 32.789µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:39 | 200 | 32.768µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:44 | 200 | 39.602µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:47 | 200 | 32.317µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:49 | 200 | 43.869µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:54 | 200 | 36.968µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:57 | 200 | 37.629µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:11:59 | 200 | 33.814µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:04 | 200 | 35.261µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:07 | 200 | 42.87µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:09 | 200 | 42.135µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:14 | 200 | 40.636µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:17 | 200 | 33.635µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:19 | 200 | 32.319µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:24 | 200 | 33.412µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:27 | 200 | 42.76µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:29 | 200 | 60.533µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:34 | 200 | 33.603µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:37 | 200 | 35.734µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:39 | 200 | 32.415µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:44 | 200 | 34.207µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:47 | 200 | 42.474µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:49 | 200 | 32.663µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:54 | 200 | 33.533µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:57 | 200 | 32.329µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:12:59 | 200 | 32.454µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:04 | 200 | 35.438µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:07 | 200 | 33.665µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:09 | 200 | 32.865µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:14 | 200 | 36.29µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:17 | 200 | 42.079µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:19 | 200 | 32.793µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:24 | 200 | 36.627µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:27 | 200 | 55.286µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:29 | 200 | 36.978µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:34 | 200 | 31.875µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:37 | 200 | 50.059µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:39 | 200 | 35.991µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:44 | 200 | 31.493µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:47 | 200 | 32.425µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:49 | 200 | 42.517µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:54 | 200 | 30.976µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:57 | 200 | 38.247µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:13:59 | 200 | 31.84µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:04 | 200 | 43.472µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:07 | 200 | 31.021µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:09 | 200 | 32.13µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:14 | 200 | 32.092µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:17 | 200 | 34.587µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:19 | 200 | 35.645µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:24 | 200 | 42.246µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:27 | 200 | 30.641µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:29 | 200 | 37.837µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:34 | 200 | 34.6µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:37 | 200 | 32.877µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:39 | 200 | 33.245µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:44 | 200 | 32.648µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:47 | 200 | 33.394µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:49 | 200 | 42.002µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:54 | 200 | 43.671µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:57 | 200 | 31.531µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:14:59 | 200 | 33.604µs | 10.134.0.2 | GET "/health" {"level":"info","timestamp":"2026-07-19T06:15:02.366Z","caller":"api_keys/service.go:324","message":"Ephemeral key cleanup completed","deletedCount":0} [GIN] 2026/07/19 - 06:15:02 | 200 | 20.026831ms | 10.134.0.106 | POST "/internal/v1/api-keys/cleanup" [GIN] 2026/07/19 - 06:15:04 | 200 | 32.318µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:07 | 200 | 36.617µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:09 | 200 | 36.621µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:14 | 200 | 32.472µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:17 | 200 | 33.42µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:19 | 200 | 36.447µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:24 | 200 | 34.43µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:27 | 200 | 36.685µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:29 | 200 | 34.607µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:34 | 200 | 34.516µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:37 | 200 | 32.774µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:39 | 200 | 34.51µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:44 | 200 | 36.031µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:47 | 200 | 31.997µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:49 | 200 | 33.306µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:54 | 200 | 35.054µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:57 | 200 | 33.679µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:15:59 | 200 | 31.902µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:04 | 200 | 31.087µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:07 | 200 | 36.143µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:09 | 200 | 33.675µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:14 | 200 | 32.615µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:17 | 200 | 30.488µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:19 | 200 | 32.741µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:24 | 200 | 33.538µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:27 | 200 | 35.178µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:29 | 200 | 31.328µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:34 | 200 | 31.946µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:37 | 200 | 62.779µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:39 | 200 | 34.96µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:44 | 200 | 32.709µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:47 | 200 | 37.051µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:49 | 200 | 32.905µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:54 | 200 | 33.685µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:57 | 200 | 33.106µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:16:59 | 200 | 42.43µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:04 | 200 | 61.052µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:07 | 200 | 35.213µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:09 | 200 | 32.279µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:14 | 200 | 32.826µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:17 | 200 | 41.193µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:19 | 200 | 32.865µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:24 | 200 | 31.447µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:27 | 200 | 53.577µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:29 | 200 | 42.285µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:34 | 200 | 33.374µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:37 | 200 | 33.28µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:39 | 200 | 33.54µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:44 | 200 | 33.644µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:47 | 200 | 31.56µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:49 | 200 | 57.336µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:54 | 200 | 32.236µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:57 | 200 | 33.404µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:17:59 | 200 | 32.907µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:04 | 200 | 33.469µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:07 | 200 | 41.282µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:09 | 200 | 39.045µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:14 | 200 | 33.509µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:17 | 200 | 41.295µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:19 | 200 | 35.782µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:24 | 200 | 35.598µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:27 | 200 | 33.543µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:29 | 200 | 43.737µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:34 | 200 | 33.573µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:37 | 200 | 37.104µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:39 | 200 | 32.153µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:44 | 200 | 37.753µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:47 | 200 | 33.129µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:49 | 200 | 34.785µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:54 | 200 | 31.152µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:57 | 200 | 32.66µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:18:59 | 200 | 43.588µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:04 | 200 | 33.981µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:07 | 200 | 35.915µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:09 | 200 | 45.381µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:14 | 200 | 33.23µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:17 | 200 | 40.882µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:19 | 200 | 41.886µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:24 | 200 | 31.554µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:27 | 200 | 36.413µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:29 | 200 | 35.728µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:34 | 200 | 37.511µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:37 | 200 | 39.228µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:39 | 200 | 43.348µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:44 | 200 | 38.731µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:47 | 200 | 39.23µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:49 | 200 | 39.947µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:54 | 200 | 54.297µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:57 | 200 | 39.074µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:19:59 | 200 | 37.959µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:04 | 200 | 39.579µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:07 | 200 | 47.622µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:09 | 200 | 39.173µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:14 | 200 | 38.48µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:17 | 200 | 42.412µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:19 | 200 | 38.674µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:24 | 200 | 38.421µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:27 | 200 | 38.955µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:29 | 200 | 41.475µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:34 | 200 | 45.021µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:37 | 200 | 36.61µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:39 | 200 | 41.428µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:44 | 200 | 40.107µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:47 | 200 | 37.944µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:49 | 200 | 40.019µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:54 | 200 | 40.061µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:57 | 200 | 41.084µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:20:59 | 200 | 38.502µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:21:04 | 200 | 42.981µs | 10.134.0.2 | GET "/health" [GIN] 2026/07/19 - 06:21:07 | 200 | 51.149µs | 10.134.0.2 | GET "/health" ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-api-key-cleanup-29740695-fg4vk.log ==================== {"deletedCount":0,"message":"Successfully deleted 0 expired ephemeral key(s)"} ==================== WORKLOAD POD LOG: redhat-ods-applications/maas-controller-75bbfd978-b6748.log ==================== {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"managed namespace not found, attempting to create it","namespace":"models-as-a-service","purpose":"subscription"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"managed namespace ready","namespace":"models-as-a-service","purpose":"subscription"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"managed namespace not found, attempting to create it","namespace":"ai-tenants","purpose":"aitenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"managed namespace ready","namespace":"ai-tenants","purpose":"aitenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"watching namespace for MaaS CRs","namespace":"models-as-a-service"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"watching MaaS CRs across all namespaces for tenant discovery","defaultNamespace":"models-as-a-service","tenantNamespaceLabel":"ai-gateway.opendatahub.io/tenant","compatTenantNamespaceLabel":"maas.opendatahub.io/managed-by-aitenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"auto-detected cluster service account issuer","audience":"https://prod-eaas-bucket.s3.us-east-1.amazonaws.com/e0497fd6acd0"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"Tenant platform kustomize path","path":"/maas-api/deploy/overlays/odh"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"maas.opendatahub.io/v1alpha1, Kind=AITenant","path":"/validate-maas-opendatahub-io-v1alpha1-aitenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-maas-opendatahub-io-v1alpha1-aitenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"maas.opendatahub.io/v1alpha1, Kind=MaaSSubscription","path":"/validate-maas-opendatahub-io-v1alpha1-maassubscription"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-maas-opendatahub-io-v1alpha1-maassubscription"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"maas.opendatahub.io/v1alpha1, Kind=MaaSAuthPolicy","path":"/validate-maas-opendatahub-io-v1alpha1-maasauthpolicy"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-maas-opendatahub-io-v1alpha1-maasauthpolicy"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"starting manager"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"starting server","name":"health probe","addr":"[::]:8081"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":":8080","secure":false} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.webhook","msg":"Starting webhook server"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"controller-runtime.certwatcher","msg":"Starting certificate poll+watcher","interval":10} I0719 06:01:43.511715 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/maas-controller.models-as-a-service.opendatahub.io... I0719 06:01:43.518145 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/maas-controller.models-as-a-service.opendatahub.io {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasmodelref","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSModelRef","source":"kind source: *v1alpha1.MaaSAuthPolicy"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription","source":"kind source: *v1.Namespace"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasmodelref","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSModelRef","source":"kind source: *v1alpha1.MaaSModelRef"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasmodelref","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSModelRef","source":"kind source: *v1.HTTPRoute"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasmodelref","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSModelRef","source":"kind source: *v1alpha1.LLMInferenceService"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasmodelref","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSModelRef","source":"kind source: *v1alpha1.MaaSSubscription"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy","source":"kind source: *v1.Namespace"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"external-model-reconciler","controllerGroup":"maas.opendatahub.io","controllerKind":"ExternalModel","source":"kind source: *v1alpha1.ExternalModel"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription","source":"kind source: *v1alpha1.MaaSSubscription"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription","source":"kind source: *v1alpha1.MaaSSubscription"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy","source":"kind source: *v1alpha1.MaaSAuthPolicy"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription","source":"kind source: *v1.HTTPRoute"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy","source":"kind source: *v1.HTTPRoute"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription","source":"kind source: *v1alpha1.MaaSModelRef"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy","source":"kind source: *v1alpha1.MaaSModelRef"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy","source":"kind source: *unstructured.Unstructured"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"aitenant","controllerGroup":"maas.opendatahub.io","controllerKind":"AITenant","source":"kind source: *v1alpha1.AITenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","source":"kind source: *v1alpha1.Tenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","source":"kind source: *v1.PartialObjectMetadata"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","source":"kind source: *v1.Deployment"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","source":"kind source: *v1alpha1.Config"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","source":"kind source: *v1alpha1.Tenant"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","source":"kind source: *v1alpha1.Config"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","source":"kind source: *v1.CustomResourceDefinition"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","source":"kind source: *v1.CustomResourceDefinition"} {"level":"info","ts":"2026-07-19T06:01:43Z","msg":"Starting EventSource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","source":"kind source: *v1.Secret"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:01:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting Controller","controller":"aitenant","controllerGroup":"maas.opendatahub.io","controllerKind":"AITenant"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting workers","controller":"aitenant","controllerGroup":"maas.opendatahub.io","controllerKind":"AITenant","worker count":1} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting Controller","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting workers","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","worker count":1} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting Controller","controller":"external-model-reconciler","controllerGroup":"maas.opendatahub.io","controllerKind":"ExternalModel"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting workers","controller":"external-model-reconciler","controllerGroup":"maas.opendatahub.io","controllerKind":"ExternalModel","worker count":1} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting Controller","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting workers","controller":"maassubscription","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSSubscription","worker count":1} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting Controller","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting workers","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","worker count":1} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting Controller","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting workers","controller":"maasauthpolicy","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSAuthPolicy","worker count":1} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting Controller","controller":"maasmodelref","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSModelRef"} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"Starting workers","controller":"maasmodelref","controllerGroup":"maas.opendatahub.io","controllerKind":"MaaSModelRef","worker count":1} {"level":"info","ts":"2026-07-19T06:01:45Z","msg":"set Config owner reference on maas-controller Deployment","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","Deployment":{"name":"maas-controller","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"maas-controller","reconcileID":"c5dc2593-a89a-4b60-9270-4e02c9a4c796","deployment":{"name":"maas-controller","namespace":"redhat-ods-applications"}} {"level":"info","ts":"2026-07-19T06:01:54Z","msg":"set Config owner reference on maas-controller Deployment","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","Deployment":{"name":"maas-controller","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"maas-controller","reconcileID":"5469451a-f8f0-4681-bd4b-10f9f83edf6f","deployment":{"name":"maas-controller","namespace":"redhat-ods-applications"}} {"level":"info","ts":"2026-07-19T06:02:13Z","logger":"setup.ensureClusterBootstrap","msg":"ensured default-tenant exists","namespace":"models-as-a-service"} {"level":"info","ts":"2026-07-19T06:02:13Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:02:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:02:13Z","msg":"set Config owner reference on default-tenant","controller":"deployment","controllerGroup":"apps","controllerKind":"Deployment","Deployment":{"name":"maas-controller","namespace":"redhat-ods-applications"},"namespace":"redhat-ods-applications","name":"maas-controller","reconcileID":"ad2000cc-8568-4de4-9856-d9e759d1c910","namespace":"models-as-a-service"} {"level":"info","ts":"2026-07-19T06:02:14Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:14Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"667eee1d-2823-4307-ad1b-d4eded477afa","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:14Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:14Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:14Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"667eee1d-2823-4307-ad1b-d4eded477afa","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"667eee1d-2823-4307-ad1b-d4eded477afa","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:15Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"667eee1d-2823-4307-ad1b-d4eded477afa","error":"Operation cannot be fulfilled on tenants.maas.opendatahub.io \"default-tenant\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"15ef8801-66ea-4f0d-a867-84131e4e025e","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"15ef8801-66ea-4f0d-a867-84131e4e025e","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"15ef8801-66ea-4f0d-a867-84131e4e025e","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:15Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"290d04a9-f6f2-4cf1-abd8-1de4b6ccabbc","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:15Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:16Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"290d04a9-f6f2-4cf1-abd8-1de4b6ccabbc","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:16Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"290d04a9-f6f2-4cf1-abd8-1de4b6ccabbc","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:16Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"290d04a9-f6f2-4cf1-abd8-1de4b6ccabbc","error":"Operation cannot be fulfilled on tenants.maas.opendatahub.io \"default-tenant\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:16Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"15a195e1-e733-4b8f-b2ad-b698a2e4af70","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:16Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"15a195e1-e733-4b8f-b2ad-b698a2e4af70","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:16Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"15a195e1-e733-4b8f-b2ad-b698a2e4af70","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:16Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"7169eb8f-8e40-4ef7-8790-f60489d03012","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:16Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:17Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"7169eb8f-8e40-4ef7-8790-f60489d03012","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:17Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"7169eb8f-8e40-4ef7-8790-f60489d03012","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:17Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:17Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:20Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:20Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"12e3b15f-b003-489d-9dfc-809656dc0d42","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:20Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:20Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"b62f4e3a-1c0c-40b3-8b32-af8badf2ea92","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:34Z","logger":"controller-runtime.healthz","msg":"healthz check failed","statuses":[{}]} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:36Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f85264c0-dacd-4f87-bcb4-968690ac1226","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:36Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f85264c0-dacd-4f87-bcb4-968690ac1226","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:36Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f85264c0-dacd-4f87-bcb4-968690ac1226","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:36Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f85264c0-dacd-4f87-bcb4-968690ac1226","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:36Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f85264c0-dacd-4f87-bcb4-968690ac1226","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:36Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"9951f768-6a0a-4b35-9afc-92e281730b54","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:36Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:36Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"9951f768-6a0a-4b35-9afc-92e281730b54","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"9951f768-6a0a-4b35-9afc-92e281730b54","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:37Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"9951f768-6a0a-4b35-9afc-92e281730b54","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:37Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"9951f768-6a0a-4b35-9afc-92e281730b54","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:37Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"8fac0783-4c56-4e9a-968b-6f867d8123b8","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:37Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"8fac0783-4c56-4e9a-968b-6f867d8123b8","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"8fac0783-4c56-4e9a-968b-6f867d8123b8","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:37Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"8fac0783-4c56-4e9a-968b-6f867d8123b8","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:37Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"8fac0783-4c56-4e9a-968b-6f867d8123b8","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:37Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"819d444d-273a-4a02-acdb-ba3c8226549a","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:37Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"819d444d-273a-4a02-acdb-ba3c8226549a","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:37Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:38Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"819d444d-273a-4a02-acdb-ba3c8226549a","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:38Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"819d444d-273a-4a02-acdb-ba3c8226549a","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:38Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"819d444d-273a-4a02-acdb-ba3c8226549a","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:38Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"18e58213-e838-4fc0-a3e3-9ec23cb6a853","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:38Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"18e58213-e838-4fc0-a3e3-9ec23cb6a853","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:38Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"18e58213-e838-4fc0-a3e3-9ec23cb6a853","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:38Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"18e58213-e838-4fc0-a3e3-9ec23cb6a853","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:38Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"18e58213-e838-4fc0-a3e3-9ec23cb6a853","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:38Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"115c123d-c18a-45d5-8ecc-564b9c6f0362","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:38Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"115c123d-c18a-45d5-8ecc-564b9c6f0362","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:38Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:39Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"115c123d-c18a-45d5-8ecc-564b9c6f0362","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:39Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"115c123d-c18a-45d5-8ecc-564b9c6f0362","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:39Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"115c123d-c18a-45d5-8ecc-564b9c6f0362","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:39Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"65365afb-ff4b-437e-a194-59a7fa0489a0","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:39Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"65365afb-ff4b-437e-a194-59a7fa0489a0","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:39Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"65365afb-ff4b-437e-a194-59a7fa0489a0","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:39Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"65365afb-ff4b-437e-a194-59a7fa0489a0","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:39Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:39Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"65365afb-ff4b-437e-a194-59a7fa0489a0","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:40Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:40Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"a7862359-980a-4e64-9d18-328f21fd92cb","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:40Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:40Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"a7862359-980a-4e64-9d18-328f21fd92cb","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:40Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:40Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:40Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:40Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"a7862359-980a-4e64-9d18-328f21fd92cb","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:40Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"a7862359-980a-4e64-9d18-328f21fd92cb","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:40Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:40Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:40Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"a7862359-980a-4e64-9d18-328f21fd92cb","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:41Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:41Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d76c6090-0db9-4fac-bbd7-f353582e0655","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:41Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:41Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d76c6090-0db9-4fac-bbd7-f353582e0655","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:41Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:41Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:41Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:41Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d76c6090-0db9-4fac-bbd7-f353582e0655","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:41Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d76c6090-0db9-4fac-bbd7-f353582e0655","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:41Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:41Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:41Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"d76c6090-0db9-4fac-bbd7-f353582e0655","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:42Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:42Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"71771a6f-721c-442d-abe2-103ce290792e","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"71771a6f-721c-442d-abe2-103ce290792e","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"71771a6f-721c-442d-abe2-103ce290792e","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:43Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"71771a6f-721c-442d-abe2-103ce290792e","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:43Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"71771a6f-721c-442d-abe2-103ce290792e","error":"namespaces \"models-as-a-service\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"setup","msg":"managed namespace not found, attempting to create it","namespace":"models-as-a-service","purpose":"subscription"} {"level":"info","ts":"2026-07-19T06:02:43Z","logger":"setup","msg":"managed namespace ready","namespace":"models-as-a-service","purpose":"subscription"} {"level":"info","ts":"2026-07-19T06:02:45Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"error","ts":"2026-07-19T06:02:45Z","msg":"MaaS prerequisite error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"a51e2159-f4d7-4f5f-b489-3513f711d605","check":"database-secret","message":"database Secret 'maas-db-config' not found in namespace 'redhat-ods-applications'. Create the Secret with key 'DB_CONNECTION_URL' containing the PostgreSQL connection URL. MaaS API cannot start without a database connection","stacktrace":"github.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile.CollectPrerequisiteReport\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/platform/tenantreconcile/prerequisites.go:54\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).checkDependenciesAndPrerequisites\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:278\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_reconcile.go:152\ngithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas.(*TenantReconciler).Reconcile\n\tgithub.com/opendatahub-io/models-as-a-service/maas-controller/pkg/controller/maas/tenant_controller.go:131\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"c902b2a2-927d-4751-9be9-7536a7912d72","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"c902b2a2-927d-4751-9be9-7536a7912d72","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"c902b2a2-927d-4751-9be9-7536a7912d72","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:51Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"0d635363-f199-4a74-aed1-8f405354c829","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:51Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"0d635363-f199-4a74-aed1-8f405354c829","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"0d635363-f199-4a74-aed1-8f405354c829","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"error","ts":"2026-07-19T06:02:52Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"0d635363-f199-4a74-aed1-8f405354c829","error":"Operation cannot be fulfilled on tenants.maas.opendatahub.io \"default-tenant\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"3800273c-dc4c-4583-a7d9-c828f12d6632","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"3800273c-dc4c-4583-a7d9-c828f12d6632","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"3800273c-dc4c-4583-a7d9-c828f12d6632","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"045eef2e-0e4b-4990-8874-e5fa46e11eef","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"045eef2e-0e4b-4990-8874-e5fa46e11eef","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"045eef2e-0e4b-4990-8874-e5fa46e11eef","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:02:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:03:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:03:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:03:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:03:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:04:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:04:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:04:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:04:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:05:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:05:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:05:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:06:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:06:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:06:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:06:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:07:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:07:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:07:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:07:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:07:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:07:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:07:52Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"883636a7-533a-49a2-8576-76837a071732","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:07:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:07:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:07:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:07:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"883636a7-533a-49a2-8576-76837a071732","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:07:52Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"883636a7-533a-49a2-8576-76837a071732","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:07:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:07:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:08:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:08:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:08:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:08:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:09:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:09:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:09:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:09:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:10:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:10:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:10:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:10:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:11:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:11:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:11:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:11:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:12:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:12:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:12:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:12:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:12:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:12:52Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:12:52Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"3f558b22-41bb-468e-aea3-470cbabacaad","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:12:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:12:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:12:52Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:12:53Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"3f558b22-41bb-468e-aea3-470cbabacaad","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:12:53Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"3f558b22-41bb-468e-aea3-470cbabacaad","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:12:53Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:12:53Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:13:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:13:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:13:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:14:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:14:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:14:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:14:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:15:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:15:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:15:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:15:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:16:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:16:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:16:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:16:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:17:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:17:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:17:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:17:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:17:53Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:17:53Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:17:53Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f06a1b00-1151-4bd3-9dfb-5d0b88e93954","tenant":"models-as-a-service/default-tenant","tenantID":"","subscriptionNamespace":"models-as-a-service","gatewayName":"maas-default-gateway"} {"level":"info","ts":"2026-07-19T06:17:53Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:17:53Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:17:53Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:17:53Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f06a1b00-1151-4bd3-9dfb-5d0b88e93954","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:17:53Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"models-as-a-service"},"namespace":"models-as-a-service","name":"default-tenant","reconcileID":"f06a1b00-1151-4bd3-9dfb-5d0b88e93954","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:17:53Z","logger":"TenantIdentifierFor","msg":"Using legacy/default tenant identifier (empty string)","tenant":"models-as-a-service/default-tenant","labels":null,"reason":"no AITenant label"} {"level":"info","ts":"2026-07-19T06:17:53Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"","deploymentName":"maas-api"} {"level":"info","ts":"2026-07-19T06:18:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:18:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:18:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:18:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:19:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:19:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:19:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:19:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:20:05Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:05Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:05Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"92aba702-19dc-49cc-9b9e-bed9dfe9faca","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","tenantID":"e2e-aigw-f978966b","subscriptionNamespace":"ai-tenant-e2e-aigw-f978966b","gatewayName":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:05Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:05Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:05Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"92aba702-19dc-49cc-9b9e-bed9dfe9faca","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"92aba702-19dc-49cc-9b9e-bed9dfe9faca","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","msg":"Built platform params","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"08bfcc8f-5081-476d-a874-fc65052b01ca","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","tenantID":"e2e-aigw-f978966b","subscriptionNamespace":"ai-tenant-e2e-aigw-f978966b","gatewayName":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:06Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"08bfcc8f-5081-476d-a874-fc65052b01ca","group":"perses.dev","kind":"PersesDatasource","name":"kuadrant-prometheus-datasource","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"skipping resource: optional CRD not yet registered, will apply once installed","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"08bfcc8f-5081-476d-a874-fc65052b01ca","group":"perses.dev","kind":"PersesDashboard","name":"dashboard-3-maas-usage-admin","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"error","ts":"2026-07-19T06:20:07Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"08bfcc8f-5081-476d-a874-fc65052b01ca","error":"Operation cannot be fulfilled on tenants.maas.opendatahub.io \"default-tenant\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Cleaning up MaaSAuthPolicy CRs","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"eb94d672-15f1-46fb-810f-f09e0d7c2804","namespace":"ai-tenant-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Cleaned up MaaSAuthPolicy CRs","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"eb94d672-15f1-46fb-810f-f09e0d7c2804","count":0} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Cleaning up per-tenant maas-api resources","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"eb94d672-15f1-46fb-810f-f09e0d7c2804","tenant":"e2e-aigw-f978966b","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"eb94d672-15f1-46fb-810f-f09e0d7c2804","gvk":"Deployment","name":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"eb94d672-15f1-46fb-810f-f09e0d7c2804","gvk":"Service","name":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"eb94d672-15f1-46fb-810f-f09e0d7c2804","gvk":"HTTPRoute","name":"maas-api-e2e-aigw-f978966b-route"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"eb94d672-15f1-46fb-810f-f09e0d7c2804","gvk":"CronJob","name":"maas-api-key-cleanup-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Cleaning up MaaSAuthPolicy CRs","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","namespace":"ai-tenant-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Cleaned up MaaSAuthPolicy CRs","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","count":0} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"TenantIdentifierFor","msg":"Resolved tenant identifier from AITenant label","tenant":"ai-tenant-e2e-aigw-f978966b/default-tenant","labels":{"ai-gateway.opendatahub.io/tenant":"e2e-aigw-f978966b","app.kubernetes.io/managed-by":"maas-controller","app.kubernetes.io/part-of":"modelsasservice","maas.opendatahub.io/managed-by-aitenant":"true","maas.opendatahub.io/tenant-name":"e2e-aigw-f978966b","maas.opendatahub.io/tenant-namespace":"ai-tenant-e2e-aigw-f978966b"},"tenantIdentifier":"e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Cleaning up per-tenant maas-api resources","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","tenant":"e2e-aigw-f978966b","namespace":"redhat-ods-applications"} {"level":"info","ts":"2026-07-19T06:20:07Z","logger":"MaaSAPIDeploymentName","msg":"Generated deployment name","tenantID":"e2e-aigw-f978966b","deploymentName":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","gvk":"Deployment","name":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","gvk":"Service","name":"maas-api-e2e-aigw-f978966b"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","gvk":"HTTPRoute","name":"maas-api-e2e-aigw-f978966b-route"} {"level":"info","ts":"2026-07-19T06:20:07Z","msg":"Deleted tenant resource","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","gvk":"CronJob","name":"maas-api-key-cleanup-e2e-aigw-f978966b"} {"level":"error","ts":"2026-07-19T06:20:07Z","msg":"Reconciler error","controller":"tenant","controllerGroup":"maas.opendatahub.io","controllerKind":"Tenant","Tenant":{"name":"default-tenant","namespace":"ai-tenant-e2e-aigw-f978966b"},"namespace":"ai-tenant-e2e-aigw-f978966b","name":"default-tenant","reconcileID":"1fc15e7d-4a08-48fc-9844-ee049bbfe500","error":"tenants.maas.opendatahub.io \"default-tenant\" not found","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:347\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\tsigs.k8s.io/controller-runtime@v0.20.4/pkg/internal/controller/controller.go:255"} {"level":"info","ts":"2026-07-19T06:20:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:20:13Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} {"level":"info","ts":"2026-07-19T06:20:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"ai-tenants","purpose":"aitenant","phase":"Active"} {"level":"info","ts":"2026-07-19T06:20:43Z","logger":"setup","msg":"managed namespace already exists","namespace":"models-as-a-service","purpose":"subscription","phase":"Active"} ==================== WORKLOAD POD LOG: redhat-ods-applications/model-serving-api-5679d6b4f-gdpkf.log ==================== {"time":"2026-07-19T05:46:49.097440425Z","level":"INFO","msg":"metrics server starting","addr":":8080"} {"time":"2026-07-19T05:46:49.09759055Z","level":"INFO","msg":"server starting","addr":":8443","tls":true} ==================== WORKLOAD POD LOG: redhat-ods-applications/odh-model-controller-bd4c5cbcb-df59g.log ==================== 2026-07-19T05:46:47Z INFO setup Model registry inference service reconciliation disabled. To enable model registry reconciliation for InferenceService, please provide --model-registry-inference-reconcile flag. 2026-07-19T05:46:47Z INFO setup Setting up LLMInferenceService controller 2026-07-19T05:46:47Z INFO setup Setting up Gateway controller for EnvoyFilter/AuthPolicy bootstrap {"envoyFilterCRD": true, "authPolicyCRD": true} 2026-07-19T05:46:47Z INFO controller-runtime.builder Registering a mutating webhook {"GVK": "/v1, Kind=Pod", "path": "/mutate--v1-pod"} 2026-07-19T05:46:47Z INFO controller-runtime.webhook Registering webhook {"path": "/mutate--v1-pod"} 2026-07-19T05:46:47Z INFO controller-runtime.builder skip registering a validating webhook, object does not implement admission.Validator or WithValidator wasn't called {"GVK": "/v1, Kind=Pod"} 2026-07-19T05:46:47Z INFO controller-runtime.builder skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called {"GVK": "nim.opendatahub.io/v1, Kind=Account"} 2026-07-19T05:46:47Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "nim.opendatahub.io/v1, Kind=Account", "path": "/validate-nim-opendatahub-io-v1-account"} 2026-07-19T05:46:47Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-nim-opendatahub-io-v1-account"} 2026-07-19T05:46:47Z INFO controller-runtime.builder Registering a mutating webhook {"GVK": "serving.kserve.io/v1beta1, Kind=InferenceService", "path": "/mutate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-19T05:46:47Z INFO controller-runtime.webhook Registering webhook {"path": "/mutate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-19T05:46:47Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "serving.kserve.io/v1beta1, Kind=InferenceService", "path": "/validate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-19T05:46:47Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-serving-kserve-io-v1beta1-inferenceservice"} 2026-07-19T05:46:47Z INFO controller-runtime.builder Registering a mutating webhook {"GVK": "serving.kserve.io/v1alpha1, Kind=InferenceGraph", "path": "/mutate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-19T05:46:47Z INFO controller-runtime.webhook Registering webhook {"path": "/mutate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-19T05:46:47Z INFO controller-runtime.builder Registering a validating webhook {"GVK": "serving.kserve.io/v1alpha1, Kind=InferenceGraph", "path": "/validate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-19T05:46:47Z INFO controller-runtime.webhook Registering webhook {"path": "/validate-serving-kserve-io-v1alpha1-inferencegraph"} 2026-07-19T05:46:47Z INFO setup starting manager 2026-07-19T05:46:47Z INFO controller-runtime.metrics Starting metrics server 2026-07-19T05:46:47Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8080", "secure": false} 2026-07-19T05:46:47Z INFO starting server {"name": "health probe", "addr": "[::]:8081"} 2026-07-19T05:46:47Z INFO controller-runtime.webhook Starting webhook server 2026-07-19T05:46:47Z INFO setup disabling http/2 2026-07-19T05:46:47Z INFO controller-runtime.certwatcher Updated current TLS certificate 2026-07-19T05:46:47Z INFO controller-runtime.webhook Serving webhook server {"host": "", "port": 9443} 2026-07-19T05:46:47Z INFO controller-runtime.certwatcher Starting certificate poll+watcher {"interval": "10s"} I0719 05:46:48.079483 1 leaderelection.go:257] attempting to acquire leader lease redhat-ods-applications/odh-model-controller.opendatahub.io... I0719 05:46:48.088167 1 leaderelection.go:271] successfully acquired lease redhat-ods-applications/odh-model-controller.opendatahub.io 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1beta1.InferenceService"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1alpha1.ServingRuntime"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Namespace"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Route"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ServiceAccount"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Service"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ConfigMap"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Secret"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ClusterRoleBinding"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.NetworkPolicy"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.ServiceMonitor"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.PodMonitor"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Role"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.RoleBinding"} 2026-07-19T05:46:48Z DEBUG events odh-model-controller-bd4c5cbcb-df59g_2b36c3a5-8fc7-4c15-a6e2-1ab32eb89ebf became leader {"type": "Normal", "object": {"kind":"Lease","namespace":"redhat-ods-applications","name":"odh-model-controller.opendatahub.io","uid":"69fe31ba-a70d-4734-aa30-0937c9fdeb8e","apiVersion":"coordination.k8s.io/v1","resourceVersion":"41612"}, "reason": "LeaderElection"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1alpha1.TriggerAuthentication"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1alpha1.ServingRuntime"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "source": "kind source: *v1.Secret"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "source": "kind source: *v1.ConfigMap"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "source": "kind source: *v1.Secret"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1alpha1.ServingRuntime"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.RoleBinding"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.Secret"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.Namespace"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "source": "kind source: *v1.RoleBinding"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Gateway"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha3.EnvoyFilter"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.AuthPolicy"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha2.LLMInferenceService"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha2.LLMInferenceServiceConfig"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Namespace"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Account"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1alpha2.LLMInferenceService"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.ConfigMap"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1.AuthPolicy"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Secret"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1beta1.Kuadrant"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Template"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "source": "kind source: *v1beta1.Authorino"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService"} 2026-07-19T05:46:48Z INFO setup.MaaSRBACCleanup Starting MaaS RBAC cleanup 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.Secret"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "core-pod", "controllerGroup": "", "controllerKind": "Pod", "source": "kind source: *v1.Pod"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "core-pod", "controllerGroup": "", "controllerKind": "Pod"} 2026-07-19T05:46:48Z INFO Starting EventSource {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "source": "kind source: *v1.ConfigMap"} 2026-07-19T05:46:48Z INFO Starting Controller {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account"} 2026-07-19T05:46:48Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:48Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "InferenceService.serving.kserve.io", "error": "no matches for kind \"InferenceService\" in version \"serving.kserve.io/v1beta1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:48Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:48Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:48Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-authentication-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceServiceConfig.serving.kserve.io", "error": "no matches for kind \"LLMInferenceServiceConfig\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:48Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:53 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:54 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:48Z INFO setup.MaaSRBACCleanup MaaS RBAC cleanup completed {"rolesRemoved": 0, "roleBindingsRemoved": 0} 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-route-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR setup Failed to list LLMInferenceService {"error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*LLMInferenceServiceReconciler).SetupWithManager.(*LLMInferenceServiceReconciler).globalResync.func6 /workspace/internal/controller/serving/llm/llm_inferenceservice_controller.go:210 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kube-public", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-machine-approver", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-image-registry", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-infra", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-controller-manager-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-operator-lifecycle-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-csi-drivers", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-etcd", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-host-network", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kyverno", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-apiserver", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-console-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-controller-manager-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-marketplace", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR setup Failed to list LLMInferenceService {"error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*LLMInferenceServiceReconciler).SetupWithManager.(*LLMInferenceServiceReconciler).globalResync.func5 /workspace/internal/controller/serving/llm/llm_inferenceservice_controller.go:210 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-dns", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kueue-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-service-ca-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-apiserver-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z INFO Starting workers {"controller": "core-pod", "controllerGroup": "", "controllerKind": "Pod", "worker count": 1} 2026-07-19T05:46:48Z INFO Starting workers {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "worker count": 1} 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ingress", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z INFO Starting workers {"controller": "odh-nim-controller", "controllerGroup": "nim.opendatahub.io", "controllerKind": "Account", "worker count": 1} 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-diagnostics", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z INFO Starting workers {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "worker count": 1} 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-apiserver-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "open-cluster-management-agent-addon", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-keda"}, "namespace": "openshift-keda", "name": "openshift-service-ca.crt", "reconcileID": "c90de354-d0ef-44fa-98a7-3146be25237a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-keda", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:48Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cloud-network-config-controller", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:48Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-keda"}, "namespace": "openshift-keda", "name": "openshift-service-ca.crt", "reconcileID": "c90de354-d0ef-44fa-98a7-3146be25237a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-keda"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-config-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-console", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-machine-api", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-image-registry"}, "namespace": "openshift-image-registry", "name": "openshift-service-ca.crt", "reconcileID": "8d2061c9-060a-4dc6-bd05-59c6f9993877", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-image-registry", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ovn-kubernetes", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-image-registry"}, "namespace": "openshift-image-registry", "name": "openshift-service-ca.crt", "reconcileID": "8d2061c9-060a-4dc6-bd05-59c6f9993877", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-image-registry"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-authentication", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-config-managed", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-infra"}, "namespace": "openshift-infra", "name": "openshift-service-ca.crt", "reconcileID": "6a2160eb-e653-4ac8-b86e-1b048fa2eb33", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-infra", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:49Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-infra"}, "namespace": "openshift-infra", "name": "openshift-service-ca.crt", "reconcileID": "6a2160eb-e653-4ac8-b86e-1b048fa2eb33", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-infra"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-apiserver", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-console", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-operators", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "openshift-service-ca.crt", "reconcileID": "55ecb555-f7ce-4f4d-8adf-393472623719", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-applications", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:49Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "openshift-service-ca.crt", "reconcileID": "55ecb555-f7ce-4f4d-8adf-393472623719", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-applications"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-monitoring", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kuadrant-system", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-managed"}, "namespace": "openshift-config-managed", "name": "openshift-service-ca.crt", "reconcileID": "95943f87-a42c-4bba-9f33-e3e9bdec5f2d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-managed", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-multus", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-managed"}, "namespace": "openshift-config-managed", "name": "openshift-service-ca.crt", "reconcileID": "95943f87-a42c-4bba-9f33-e3e9bdec5f2d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-managed"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-node", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-user-workload-monitoring", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cloud-controller-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ingress-canary", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-jobset-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-storage-version-migrator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:49Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "odh-trusted-ca-bundle", "reconcileID": "0fe95494-a37c-4cbb-a964-0c261169f01c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-applications"} 2026-07-19T05:46:49Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-service-ca", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-marketplace"}, "namespace": "openshift-marketplace", "name": "openshift-service-ca.crt", "reconcileID": "8c4750d2-2c4d-4848-91bc-98e52901a74f", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-marketplace", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-marketplace"}, "namespace": "openshift-marketplace", "name": "openshift-service-ca.crt", "reconcileID": "8c4750d2-2c4d-4848-91bc-98e52901a74f", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-marketplace"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "rhoai-model-registries", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-ingress-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-diagnostics"}, "namespace": "openshift-network-diagnostics", "name": "openshift-service-ca.crt", "reconcileID": "3b5f4322-2eb8-458a-a291-a752e1794ebe", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-diagnostics", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-diagnostics"}, "namespace": "openshift-network-diagnostics", "name": "openshift-service-ca.crt", "reconcileID": "3b5f4322-2eb8-458a-a291-a752e1794ebe", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-diagnostics"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "default", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kube-node-lease", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler-operator"}, "namespace": "openshift-kube-scheduler-operator", "name": "openshift-service-ca.crt", "reconcileID": "fc13a8d7-f902-4870-9d25-eeab016f1bd6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler-operator"}, "namespace": "openshift-kube-scheduler-operator", "name": "openshift-service-ca.crt", "reconcileID": "fc13a8d7-f902-4870-9d25-eeab016f1bd6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler-operator"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-storage-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-config", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "cert-manager-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "openshift-service-ca.crt", "reconcileID": "fc998cc3-0478-4e98-a194-317d80f4db3d", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "openshift-service-ca.crt", "reconcileID": "fc998cc3-0478-4e98-a194-317d80f4db3d", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-operator"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "opendatahub", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cloud-credential-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-system"}, "namespace": "kube-system", "name": "openshift-service-ca.crt", "reconcileID": "6ddaa4fe-d8bf-469f-a14b-b5830353453f", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-system", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-system"}, "namespace": "kube-system", "name": "openshift-service-ca.crt", "reconcileID": "6ddaa4fe-d8bf-469f-a14b-b5830353453f", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-system"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-scheduler", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-storage-version-migrator-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "610f12d9-5262-44d7-a2ea-0968470ae2cf", "ConfigMap": "openshift-service-ca.crt", "namespace": "cert-manager-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-network-node-identity", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "610f12d9-5262-44d7-a2ea-0968470ae2cf", "ConfigMap": "openshift-service-ca.crt", "namespace": "cert-manager-operator"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-kube-scheduler-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "cert-manager", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-samples-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-version"}, "namespace": "openshift-cluster-version", "name": "openshift-service-ca.crt", "reconcileID": "905598d1-d9c3-4bfa-a82f-d34a8a7202bc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-version", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:50Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-version"}, "namespace": "openshift-cluster-version", "name": "openshift-service-ca.crt", "reconcileID": "905598d1-d9c3-4bfa-a82f-d34a8a7202bc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-version"} 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-version", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:50Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-dns-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-insights", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operator-lifecycle-manager"}, "namespace": "openshift-operator-lifecycle-manager", "name": "openshift-service-ca.crt", "reconcileID": "85f5fdb5-ad2d-4fbc-93e1-3c764bf4c572", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operator-lifecycle-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operator-lifecycle-manager"}, "namespace": "openshift-operator-lifecycle-manager", "name": "openshift-service-ca.crt", "reconcileID": "85f5fdb5-ad2d-4fbc-93e1-3c764bf4c572", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operator-lifecycle-manager"} 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "odh-ai-gateway-infra", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "odh-model-registries", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "openshift-service-ca.crt", "reconcileID": "90a9e9d6-5480-4273-83bb-d39a20843500", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-agent-addon", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-cluster-node-tuning-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "openshift-service-ca.crt", "reconcileID": "90a9e9d6-5480-4273-83bb-d39a20843500", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-agent-addon"} 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-keda", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-machine-config-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-monitoring", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "openshift-service-ca.crt", "reconcileID": "c2c2920e-e94b-453e-a08f-c0aaf50b5967", "ConfigMap": "openshift-service-ca.crt", "namespace": "opendatahub", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "openshift-service-ca.crt", "reconcileID": "c2c2920e-e94b-453e-a08f-c0aaf50b5967", "ConfigMap": "openshift-service-ca.crt", "namespace": "opendatahub"} 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "kube-system", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-console-user-settings", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-etcd"}, "namespace": "openshift-etcd", "name": "openshift-service-ca.crt", "reconcileID": "ccb12e76-3940-4cf7-82da-fad9a42d8423", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-etcd", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-etcd"}, "namespace": "openshift-etcd", "name": "openshift-service-ca.crt", "reconcileID": "ccb12e76-3940-4cf7-82da-fad9a42d8423", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-etcd"} 2026-07-19T05:46:51Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "openshift-lws-operator", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Create /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:84 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnAdd /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:92 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnAdd /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:259 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1067 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operators"}, "namespace": "openshift-operators", "name": "openshift-service-ca.crt", "reconcileID": "952240ed-ad2b-47e1-ba4f-ced4015c704a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operators", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-operators"}, "namespace": "openshift-operators", "name": "openshift-service-ca.crt", "reconcileID": "952240ed-ad2b-47e1-ba4f-ced4015c704a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-operators"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager-operator"}, "namespace": "openshift-kube-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "891c621f-63d2-47b8-90e4-cace50cb0f3d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager-operator"}, "namespace": "openshift-kube-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "891c621f-63d2-47b8-90e4-cace50cb0f3d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "openshift-service-ca.crt", "reconcileID": "50e7a52b-25a7-4dc6-bc77-e4d8b678394a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "openshift-service-ca.crt", "reconcileID": "50e7a52b-25a7-4dc6-bc77-e4d8b678394a", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-samples-operator"}, "namespace": "openshift-cluster-samples-operator", "name": "openshift-service-ca.crt", "reconcileID": "1ba51c6b-079e-41ec-aad0-1f1cff4229dd", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-samples-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-samples-operator"}, "namespace": "openshift-cluster-samples-operator", "name": "openshift-service-ca.crt", "reconcileID": "1ba51c6b-079e-41ec-aad0-1f1cff4229dd", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-samples-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-storage-operator"}, "namespace": "openshift-cluster-storage-operator", "name": "openshift-service-ca.crt", "reconcileID": "2e2a62b0-b2c6-446a-92fb-afb9a540cc23", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-storage-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-storage-operator"}, "namespace": "openshift-cluster-storage-operator", "name": "openshift-service-ca.crt", "reconcileID": "2e2a62b0-b2c6-446a-92fb-afb9a540cc23", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-storage-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-user-workload-monitoring"}, "namespace": "openshift-user-workload-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "b39ea566-a3f8-478e-a15f-4ad449851cb6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-user-workload-monitoring", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-user-workload-monitoring"}, "namespace": "openshift-user-workload-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "b39ea566-a3f8-478e-a15f-4ad449851cb6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-user-workload-monitoring"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver-operator"}, "namespace": "openshift-kube-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "69c8ea4c-1bbd-40c7-8b28-cb0554616f17", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver-operator"}, "namespace": "openshift-kube-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "69c8ea4c-1bbd-40c7-8b28-cb0554616f17", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"default"}, "namespace": "default", "name": "openshift-service-ca.crt", "reconcileID": "bf1aa315-5768-4f5b-92bc-1bc84819ab3e", "ConfigMap": "openshift-service-ca.crt", "namespace": "default", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"default"}, "namespace": "default", "name": "openshift-service-ca.crt", "reconcileID": "bf1aa315-5768-4f5b-92bc-1bc84819ab3e", "ConfigMap": "openshift-service-ca.crt", "namespace": "default"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator-operator"}, "namespace": "openshift-kube-storage-version-migrator-operator", "name": "openshift-service-ca.crt", "reconcileID": "ac54a269-bf60-4b21-bd7f-719d4e0d2ac9", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator-operator"}, "namespace": "openshift-kube-storage-version-migrator-operator", "name": "openshift-service-ca.crt", "reconcileID": "ac54a269-bf60-4b21-bd7f-719d4e0d2ac9", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config"}, "namespace": "openshift-config", "name": "openshift-service-ca.crt", "reconcileID": "5b5d2d8f-16f9-49ce-8271-e05bd4749ed5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config"}, "namespace": "openshift-config", "name": "openshift-service-ca.crt", "reconcileID": "5b5d2d8f-16f9-49ce-8271-e05bd4749ed5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager"}, "namespace": "openshift-kube-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "bd105624-52d7-4f50-aae5-c08a806e0077", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-controller-manager"}, "namespace": "openshift-kube-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "bd105624-52d7-4f50-aae5-c08a806e0077", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-controller-manager"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-node"}, "namespace": "openshift-node", "name": "openshift-service-ca.crt", "reconcileID": "d02eea80-26bb-4f8e-a68d-ded1841cfb0d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-node", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-node"}, "namespace": "openshift-node", "name": "openshift-service-ca.crt", "reconcileID": "d02eea80-26bb-4f8e-a68d-ded1841cfb0d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-node"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-public"}, "namespace": "kube-public", "name": "openshift-service-ca.crt", "reconcileID": "1328bfe8-001b-4eea-9579-0da086f80170", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-public", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-public"}, "namespace": "kube-public", "name": "openshift-service-ca.crt", "reconcileID": "1328bfe8-001b-4eea-9579-0da086f80170", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-public"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"odh-ai-gateway-infra"}, "namespace": "odh-ai-gateway-infra", "name": "openshift-service-ca.crt", "reconcileID": "404bbd4d-a3c3-4e69-80b0-ea7b108ade98", "ConfigMap": "openshift-service-ca.crt", "namespace": "odh-ai-gateway-infra", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"odh-ai-gateway-infra"}, "namespace": "odh-ai-gateway-infra", "name": "openshift-service-ca.crt", "reconcileID": "404bbd4d-a3c3-4e69-80b0-ea7b108ade98", "ConfigMap": "openshift-service-ca.crt", "namespace": "odh-ai-gateway-infra"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver"}, "namespace": "openshift-kube-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "ac2aa177-71ea-4254-8b2b-e9582ae03ac5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-apiserver"}, "namespace": "openshift-kube-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "ac2aa177-71ea-4254-8b2b-e9582ae03ac5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-apiserver"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "odh-trusted-ca-bundle", "reconcileID": "babca706-e0a8-4b4d-8c83-fdbac3f71b00", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cert-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "odh-trusted-ca-bundle", "reconcileID": "babca706-e0a8-4b4d-8c83-fdbac3f71b00", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cert-manager"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-canary"}, "namespace": "openshift-ingress-canary", "name": "openshift-service-ca.crt", "reconcileID": "afcf3544-c70e-4046-8607-3f0921bc0ab2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-canary", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-canary"}, "namespace": "openshift-ingress-canary", "name": "openshift-service-ca.crt", "reconcileID": "afcf3544-c70e-4046-8607-3f0921bc0ab2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-canary"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver"}, "namespace": "openshift-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "14b3472e-9429-4bf8-a472-64092c2e0696", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver"}, "namespace": "openshift-apiserver", "name": "openshift-service-ca.crt", "reconcileID": "14b3472e-9429-4bf8-a472-64092c2e0696", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver"} 2026-07-19T05:46:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "odh-trusted-ca-bundle", "reconcileID": "40d02134-00d8-41f1-b272-4cc8d9663c72", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "cert-manager-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a"}, "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a", "name": "openshift-service-ca.crt", "reconcileID": "69f43e4f-96af-44b1-a700-086063b6aa8f", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a"}, "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a", "name": "openshift-service-ca.crt", "reconcileID": "69f43e4f-96af-44b1-a700-086063b6aa8f", "ConfigMap": "openshift-service-ca.crt", "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a"} 2026-07-19T05:46:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "odh-trusted-ca-bundle", "reconcileID": "3bf839e4-263e-4a7a-b831-c51028b524bd", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "open-cluster-management-agent-addon"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-network-config-controller"}, "namespace": "openshift-cloud-network-config-controller", "name": "openshift-service-ca.crt", "reconcileID": "399d8ade-c663-4806-bef1-7ea423868dfd", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-network-config-controller", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-network-config-controller"}, "namespace": "openshift-cloud-network-config-controller", "name": "openshift-service-ca.crt", "reconcileID": "399d8ade-c663-4806-bef1-7ea423868dfd", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-network-config-controller"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-multus"}, "namespace": "openshift-multus", "name": "openshift-service-ca.crt", "reconcileID": "8daab59d-054a-4231-8422-863e5f38808f", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-multus", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-multus"}, "namespace": "openshift-multus", "name": "openshift-service-ca.crt", "reconcileID": "8daab59d-054a-4231-8422-863e5f38808f", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-multus"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ovn-kubernetes"}, "namespace": "openshift-ovn-kubernetes", "name": "openshift-service-ca.crt", "reconcileID": "7a6fb660-8f08-43a7-8e42-aa1e67cd63b2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ovn-kubernetes", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ovn-kubernetes"}, "namespace": "openshift-ovn-kubernetes", "name": "openshift-service-ca.crt", "reconcileID": "7a6fb660-8f08-43a7-8e42-aa1e67cd63b2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ovn-kubernetes"} 2026-07-19T05:46:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "openshift-service-ca.crt", "reconcileID": "d5b513d9-3c10-463d-84f1-2be2577de2d5", "ConfigMap": "openshift-service-ca.crt", "namespace": "cert-manager"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns-operator"}, "namespace": "openshift-dns-operator", "name": "openshift-service-ca.crt", "reconcileID": "d211315f-5532-44ac-9eba-5e9cff1ff189", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns-operator"}, "namespace": "openshift-dns-operator", "name": "openshift-service-ca.crt", "reconcileID": "d211315f-5532-44ac-9eba-5e9cff1ff189", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-user-settings"}, "namespace": "openshift-console-user-settings", "name": "openshift-service-ca.crt", "reconcileID": "558b18fb-9843-4ec1-b994-b316d3a1686c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-user-settings", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-user-settings"}, "namespace": "openshift-console-user-settings", "name": "openshift-service-ca.crt", "reconcileID": "558b18fb-9843-4ec1-b994-b316d3a1686c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-user-settings"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver-operator"}, "namespace": "openshift-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "27b3f49c-7a9a-4615-a531-ff247fbb1f3f", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-apiserver-operator"}, "namespace": "openshift-apiserver-operator", "name": "openshift-service-ca.crt", "reconcileID": "27b3f49c-7a9a-4615-a531-ff247fbb1f3f", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-apiserver-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-operator"}, "namespace": "openshift-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "f9117bb6-5868-4e75-b538-f319fe518b0c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-config-operator"}, "namespace": "openshift-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "f9117bb6-5868-4e75-b538-f319fe518b0c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-config-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-insights"}, "namespace": "openshift-insights", "name": "openshift-service-ca.crt", "reconcileID": "5e13b2b3-b538-4b33-b252-6cb651a0bb19", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-insights", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-insights"}, "namespace": "openshift-insights", "name": "openshift-service-ca.crt", "reconcileID": "5e13b2b3-b538-4b33-b252-6cb651a0bb19", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-insights"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-node-lease"}, "namespace": "kube-node-lease", "name": "openshift-service-ca.crt", "reconcileID": "21abfaee-b325-4820-9448-2a2b727ca6d5", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-node-lease", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kube-node-lease"}, "namespace": "kube-node-lease", "name": "openshift-service-ca.crt", "reconcileID": "21abfaee-b325-4820-9448-2a2b727ca6d5", "ConfigMap": "openshift-service-ca.crt", "namespace": "kube-node-lease"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication-operator"}, "namespace": "openshift-authentication-operator", "name": "openshift-service-ca.crt", "reconcileID": "1140eaed-ddbb-4ef7-b479-3f6991edc8ac", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication-operator"}, "namespace": "openshift-authentication-operator", "name": "openshift-service-ca.crt", "reconcileID": "1140eaed-ddbb-4ef7-b479-3f6991edc8ac", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-node-identity"}, "namespace": "openshift-network-node-identity", "name": "openshift-service-ca.crt", "reconcileID": "429954e0-160d-48c0-834d-97cc8f265457", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-node-identity", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-node-identity"}, "namespace": "openshift-network-node-identity", "name": "openshift-service-ca.crt", "reconcileID": "429954e0-160d-48c0-834d-97cc8f265457", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-node-identity"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-host-network"}, "namespace": "openshift-host-network", "name": "openshift-service-ca.crt", "reconcileID": "508c7670-7eb6-4e48-8970-92943cbf5bfa", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-host-network", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-host-network"}, "namespace": "openshift-host-network", "name": "openshift-service-ca.crt", "reconcileID": "508c7670-7eb6-4e48-8970-92943cbf5bfa", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-host-network"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler"}, "namespace": "openshift-kube-scheduler", "name": "openshift-service-ca.crt", "reconcileID": "05d5aa38-4ee5-4965-8d08-fff023d788b6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-scheduler"}, "namespace": "openshift-kube-scheduler", "name": "openshift-service-ca.crt", "reconcileID": "05d5aa38-4ee5-4965-8d08-fff023d788b6", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-scheduler"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca"}, "namespace": "openshift-service-ca", "name": "openshift-service-ca.crt", "reconcileID": "bfbac98d-3171-47a0-bf93-b812e65caea4", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca"}, "namespace": "openshift-service-ca", "name": "openshift-service-ca.crt", "reconcileID": "bfbac98d-3171-47a0-bf93-b812e65caea4", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca"} 2026-07-19T05:46:51Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "odh-trusted-ca-bundle", "reconcileID": "73f269ed-cc7b-4688-a639-21516d31fa71", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "opendatahub"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-machine-approver"}, "namespace": "openshift-cluster-machine-approver", "name": "openshift-service-ca.crt", "reconcileID": "b8eddaed-71fb-4cf4-aac5-13556f12f7dd", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-machine-approver", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-machine-approver"}, "namespace": "openshift-cluster-machine-approver", "name": "openshift-service-ca.crt", "reconcileID": "b8eddaed-71fb-4cf4-aac5-13556f12f7dd", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-machine-approver"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-operator"}, "namespace": "openshift-console-operator", "name": "openshift-service-ca.crt", "reconcileID": "a8821ba2-3200-44c4-b6da-cf81ad395d71", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console-operator"}, "namespace": "openshift-console-operator", "name": "openshift-service-ca.crt", "reconcileID": "a8821ba2-3200-44c4-b6da-cf81ad395d71", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"kyverno"}, "namespace": "kyverno", "name": "odh-trusted-ca-bundle", "reconcileID": "de5f8dce-b669-4319-8f2a-e2dd26c86882", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "kyverno", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"kyverno"}, "namespace": "kyverno", "name": "odh-trusted-ca-bundle", "reconcileID": "de5f8dce-b669-4319-8f2a-e2dd26c86882", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "kyverno"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator"}, "namespace": "openshift-kube-storage-version-migrator", "name": "openshift-service-ca.crt", "reconcileID": "adee68b5-0ab9-4c9c-b8fa-570dad248ccc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kube-storage-version-migrator"}, "namespace": "openshift-kube-storage-version-migrator", "name": "openshift-service-ca.crt", "reconcileID": "adee68b5-0ab9-4c9c-b8fa-570dad248ccc", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kube-storage-version-migrator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca-operator"}, "namespace": "openshift-service-ca-operator", "name": "openshift-service-ca.crt", "reconcileID": "ff12bdc8-0bec-439f-a2aa-665be2df2534", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-service-ca-operator"}, "namespace": "openshift-service-ca-operator", "name": "openshift-service-ca.crt", "reconcileID": "ff12bdc8-0bec-439f-a2aa-665be2df2534", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-service-ca-operator"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console"}, "namespace": "openshift-console", "name": "openshift-service-ca.crt", "reconcileID": "a0203ae6-2f12-4bb2-b17e-82418b05f8ab", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:51Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-console"}, "namespace": "openshift-console", "name": "openshift-service-ca.crt", "reconcileID": "a0203ae6-2f12-4bb2-b17e-82418b05f8ab", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-console"} 2026-07-19T05:46:51Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "openshift-service-ca.crt", "reconcileID": "10959190-a4e3-494f-bcda-2a5a490f376f", "ConfigMap": "openshift-service-ca.crt", "namespace": "odh-model-registries", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "openshift-service-ca.crt", "reconcileID": "10959190-a4e3-494f-bcda-2a5a490f376f", "ConfigMap": "openshift-service-ca.crt", "namespace": "odh-model-registries"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-controller-manager"}, "namespace": "openshift-cloud-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "e066510d-e80b-4ee0-872b-692b2cf36e06", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-controller-manager"}, "namespace": "openshift-cloud-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "e066510d-e80b-4ee0-872b-692b2cf36e06", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-controller-manager"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "93ce6419-a3d1-49dc-bf1a-cbbe7e828e40", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-monitoring", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "93ce6419-a3d1-49dc-bf1a-cbbe7e828e40", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-monitoring"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-operator"}, "namespace": "openshift-ingress-operator", "name": "openshift-service-ca.crt", "reconcileID": "0f5553ec-7555-4879-a33e-2a8a4cee50f3", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-ingress-operator"}, "namespace": "openshift-ingress-operator", "name": "openshift-service-ca.crt", "reconcileID": "0f5553ec-7555-4879-a33e-2a8a4cee50f3", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-ingress-operator"} 2026-07-19T05:46:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a"}, "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a", "name": "odh-trusted-ca-bundle", "reconcileID": "b667f299-5a24-4778-bcaa-0f799251bae2", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager"}, "namespace": "openshift-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "d2c5a780-d934-48bc-8d49-c2700c65dd48", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager"}, "namespace": "openshift-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "d2c5a780-d934-48bc-8d49-c2700c65dd48", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "odh-trusted-ca-bundle", "reconcileID": "9fca52d4-b297-4de3-a051-88526a7b456e", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "rhoai-model-registries", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "odh-trusted-ca-bundle", "reconcileID": "9fca52d4-b297-4de3-a051-88526a7b456e", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "rhoai-model-registries"} 2026-07-19T05:46:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"odh-ai-gateway-infra"}, "namespace": "odh-ai-gateway-infra", "name": "odh-trusted-ca-bundle", "reconcileID": "297a416b-ce42-4589-872b-67e14695b587", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "odh-ai-gateway-infra"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-jobset-operator"}, "namespace": "openshift-jobset-operator", "name": "openshift-service-ca.crt", "reconcileID": "8a128fca-4329-4936-bbed-f60927b46150", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-jobset-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-jobset-operator"}, "namespace": "openshift-jobset-operator", "name": "openshift-service-ca.crt", "reconcileID": "8a128fca-4329-4936-bbed-f60927b46150", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-jobset-operator"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication"}, "namespace": "openshift-authentication", "name": "openshift-service-ca.crt", "reconcileID": "0a5d80d7-5ead-4daf-9ebf-904a5dc7950e", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-authentication"}, "namespace": "openshift-authentication", "name": "openshift-service-ca.crt", "reconcileID": "0a5d80d7-5ead-4daf-9ebf-904a5dc7950e", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-authentication"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-operator"}, "namespace": "openshift-network-operator", "name": "openshift-service-ca.crt", "reconcileID": "730a9927-1e98-4da5-9bbf-3db8f8797da9", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-operator"}, "namespace": "openshift-network-operator", "name": "openshift-service-ca.crt", "reconcileID": "730a9927-1e98-4da5-9bbf-3db8f8797da9", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-operator"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager-operator"}, "namespace": "openshift-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "5b2cae22-2217-49c6-b1f2-23db6066f16c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-controller-manager-operator"}, "namespace": "openshift-controller-manager-operator", "name": "openshift-service-ca.crt", "reconcileID": "5b2cae22-2217-49c6-b1f2-23db6066f16c", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-controller-manager-operator"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns"}, "namespace": "openshift-dns", "name": "openshift-service-ca.crt", "reconcileID": "1e5815a1-60f0-480e-9aa8-69c856c64e54", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-dns"}, "namespace": "openshift-dns", "name": "openshift-service-ca.crt", "reconcileID": "1e5815a1-60f0-480e-9aa8-69c856c64e54", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-dns"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "odh-trusted-ca-bundle", "reconcileID": "9e4f88ee-d24d-4840-a86c-b1e22036aed5", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "kuadrant-system", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "odh-trusted-ca-bundle", "reconcileID": "9e4f88ee-d24d-4840-a86c-b1e22036aed5", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "kuadrant-system"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-csi-drivers"}, "namespace": "openshift-cluster-csi-drivers", "name": "openshift-service-ca.crt", "reconcileID": "c8de73bb-243a-4cb4-93d6-79f7d6aaed9d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-csi-drivers", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-csi-drivers"}, "namespace": "openshift-cluster-csi-drivers", "name": "openshift-service-ca.crt", "reconcileID": "c8de73bb-243a-4cb4-93d6-79f7d6aaed9d", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-csi-drivers"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kueue-operator"}, "namespace": "openshift-kueue-operator", "name": "openshift-service-ca.crt", "reconcileID": "6d2edee5-db2a-47d5-ad75-de5f1181a9e1", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kueue-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-kueue-operator"}, "namespace": "openshift-kueue-operator", "name": "openshift-service-ca.crt", "reconcileID": "6d2edee5-db2a-47d5-ad75-de5f1181a9e1", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-kueue-operator"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-api"}, "namespace": "openshift-machine-api", "name": "openshift-service-ca.crt", "reconcileID": "e18b933c-35e3-43fb-9985-ebd13e173130", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-api", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-api"}, "namespace": "openshift-machine-api", "name": "openshift-service-ca.crt", "reconcileID": "e18b933c-35e3-43fb-9985-ebd13e173130", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-api"} 2026-07-19T05:46:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "odh-trusted-ca-bundle", "reconcileID": "46e7adc3-4659-4cb8-a045-bdde556909c4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "odh-model-registries"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "odh-trusted-ca-bundle", "reconcileID": "cfb6f80e-b26a-43f5-9076-4910b9f427e5", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-monitoring", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "odh-trusted-ca-bundle", "reconcileID": "cfb6f80e-b26a-43f5-9076-4910b9f427e5", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-monitoring"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift"}, "namespace": "openshift", "name": "openshift-service-ca.crt", "reconcileID": "45f3411a-9039-417a-8ad9-e5b4a3a2b2f2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift"}, "namespace": "openshift", "name": "openshift-service-ca.crt", "reconcileID": "45f3411a-9039-417a-8ad9-e5b4a3a2b2f2", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-lws-operator"}, "namespace": "openshift-lws-operator", "name": "openshift-service-ca.crt", "reconcileID": "fea01d82-a471-40ee-bf61-684b7911a514", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-lws-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-lws-operator"}, "namespace": "openshift-lws-operator", "name": "openshift-service-ca.crt", "reconcileID": "fea01d82-a471-40ee-bf61-684b7911a514", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-lws-operator"} 2026-07-19T05:46:52Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "openshift-service-ca.crt", "reconcileID": "e5c51092-7245-46c2-ad44-79832c9c1274", "ConfigMap": "openshift-service-ca.crt", "namespace": "kuadrant-system"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-credential-operator"}, "namespace": "openshift-cloud-credential-operator", "name": "openshift-service-ca.crt", "reconcileID": "f36299b5-04bc-4a3a-99d8-1033994a71fb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-credential-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cloud-credential-operator"}, "namespace": "openshift-cloud-credential-operator", "name": "openshift-service-ca.crt", "reconcileID": "f36299b5-04bc-4a3a-99d8-1033994a71fb", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cloud-credential-operator"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-console"}, "namespace": "openshift-network-console", "name": "openshift-service-ca.crt", "reconcileID": "bf35c236-0506-4c8d-8b62-2a525d0bf818", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-console", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-network-console"}, "namespace": "openshift-network-console", "name": "openshift-service-ca.crt", "reconcileID": "bf35c236-0506-4c8d-8b62-2a525d0bf818", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-network-console"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-route-controller-manager"}, "namespace": "openshift-route-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "fa3b040a-9b26-483c-bd1a-033a477dff11", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-route-controller-manager", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:52Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-route-controller-manager"}, "namespace": "openshift-route-controller-manager", "name": "openshift-service-ca.crt", "reconcileID": "fa3b040a-9b26-483c-bd1a-033a477dff11", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-route-controller-manager"} 2026-07-19T05:46:52Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-node-tuning-operator"}, "namespace": "openshift-cluster-node-tuning-operator", "name": "openshift-service-ca.crt", "reconcileID": "bd6623f1-17ac-45dd-b349-411013cdaced", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-node-tuning-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:53Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-cluster-node-tuning-operator"}, "namespace": "openshift-cluster-node-tuning-operator", "name": "openshift-service-ca.crt", "reconcileID": "bd6623f1-17ac-45dd-b349-411013cdaced", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-cluster-node-tuning-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "odh-trusted-ca-bundle", "reconcileID": "fa482ffe-a85d-434a-a399-a6f5b2328bd5", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "redhat-ods-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "openshift-service-ca.crt", "reconcileID": "a17d32ae-ed80-4b03-ab28-0ecddbcbffe6", "ConfigMap": "openshift-service-ca.crt", "namespace": "rhoai-model-registries"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"kyverno"}, "namespace": "kyverno", "name": "openshift-service-ca.crt", "reconcileID": "88613755-6f42-407d-96be-8ccfc607a143", "ConfigMap": "openshift-service-ca.crt", "namespace": "kyverno"} 2026-07-19T05:46:53Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-config-operator"}, "namespace": "openshift-machine-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "ba248259-a7ff-4be3-b7e6-8288c18271d9", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-config-operator", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T05:46:53Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openshift-machine-config-operator"}, "namespace": "openshift-machine-config-operator", "name": "openshift-service-ca.crt", "reconcileID": "ba248259-a7ff-4be3-b7e6-8288c18271d9", "ConfigMap": "openshift-service-ca.crt", "namespace": "openshift-machine-config-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "openshift-service-ca.crt", "reconcileID": "331ee350-604d-42ca-8a3f-3c08b4ad283d", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-monitoring"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-keda"}, "namespace": "openshift-keda", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b8aa1aa8-9650-4e09-bb3a-3375ab4d5306", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-keda"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-image-registry"}, "namespace": "openshift-image-registry", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b1dcc2bb-6b78-4421-999e-1d12db5a5d44", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-image-registry"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-infra"}, "namespace": "openshift-infra", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "421064e1-0e2c-4e28-ad3a-eed3622bd34e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-infra"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "18c1faf5-2064-4d52-be3f-2748aee4bbd5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "redhat-ods-applications"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-config-managed"}, "namespace": "openshift-config-managed", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d8616b6d-b572-45fd-87eb-013fbf4f8a75", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-config-managed"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-marketplace"}, "namespace": "openshift-marketplace", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "dd68d83e-87c4-46be-8bda-8c42096a999f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-marketplace"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-diagnostics"}, "namespace": "openshift-network-diagnostics", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a1bb9fe4-7e36-4917-b7cd-d66054cee721", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-diagnostics"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-scheduler-operator"}, "namespace": "openshift-kube-scheduler-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ed71f64e-f266-445e-9983-40596356f946", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-scheduler-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"redhat-ods-operator"}, "namespace": "redhat-ods-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ecf714f7-d930-420b-b9a7-a49307f7f093", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "redhat-ods-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kube-system"}, "namespace": "kube-system", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "27acfb27-3ee5-4c86-9b07-1dd8c96b4ed6", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kube-system"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cert-manager-operator"}, "namespace": "cert-manager-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bb4375af-2707-4cbc-b05e-9a4d639d4288", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cert-manager-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-version"}, "namespace": "openshift-cluster-version", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a40df925-d799-4507-87f4-30b8edd96fa9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-version"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-operator-lifecycle-manager"}, "namespace": "openshift-operator-lifecycle-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a9942ac2-ae22-450a-846c-f6c48b9e4d33", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-operator-lifecycle-manager"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"open-cluster-management-agent-addon"}, "namespace": "open-cluster-management-agent-addon", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4072bb53-6d0b-46bc-9ce8-45fba177d0c2", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "open-cluster-management-agent-addon"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"opendatahub"}, "namespace": "opendatahub", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "94522d70-79c6-4fe8-9f4b-fa1d71281ee7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "opendatahub"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-etcd"}, "namespace": "openshift-etcd", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "636f05ba-1968-472f-a91b-ea6851dd14b7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-etcd"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-operators"}, "namespace": "openshift-operators", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "27d4681b-beef-4fe4-bbef-a9ce611d8d4c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-operators"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-controller-manager-operator"}, "namespace": "openshift-kube-controller-manager-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4e6564e6-0965-49a8-8ab5-2ae51ab7ea43", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-controller-manager-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f5f24572-def5-4361-a196-0dcf70fc8147", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ingress"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-samples-operator"}, "namespace": "openshift-cluster-samples-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "edcf0401-066b-4710-8c39-146927447ace", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-samples-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-storage-operator"}, "namespace": "openshift-cluster-storage-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b259f115-dd52-4771-bd72-4a883ebaff33", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-storage-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-user-workload-monitoring"}, "namespace": "openshift-user-workload-monitoring", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b41e93d3-5e42-4b28-b19d-ae43486551bd", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-user-workload-monitoring"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-apiserver-operator"}, "namespace": "openshift-kube-apiserver-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ecaf8b7a-011c-49da-8d20-bd6332686749", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-apiserver-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"default"}, "namespace": "default", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "71ed2cc0-a12f-451a-8a00-53b361002c52", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "default"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-storage-version-migrator-operator"}, "namespace": "openshift-kube-storage-version-migrator-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "41a05cd1-0801-44f4-a5f4-8b13077cb871", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-storage-version-migrator-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-config"}, "namespace": "openshift-config", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c6175a8e-e7bd-47d1-8809-047831a1fbe7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-config"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-controller-manager"}, "namespace": "openshift-kube-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "633abb4e-e19c-4844-9d9b-a80c6854c7cd", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-controller-manager"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-node"}, "namespace": "openshift-node", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "55c313de-b9b2-49c0-828e-012b2d038842", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-node"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kube-public"}, "namespace": "kube-public", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "92444587-36df-4b64-b767-d9fe175843a1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kube-public"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"odh-ai-gateway-infra"}, "namespace": "odh-ai-gateway-infra", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bc2f384a-6bad-48a0-9fe1-75418765883b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "odh-ai-gateway-infra"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-apiserver"}, "namespace": "openshift-kube-apiserver", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ca61f1b2-ca06-4b19-ae37-53a98ab27b15", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-apiserver"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"cert-manager"}, "namespace": "cert-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "68508330-f6b5-4aa0-89b7-38a2ae45251f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "cert-manager"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ingress-canary"}, "namespace": "openshift-ingress-canary", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "35ffd733-7629-49bf-8d2f-475a51384fd4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ingress-canary"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-apiserver"}, "namespace": "openshift-apiserver", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "30c50eef-d1a4-4aa4-ad16-6aeacdd41faa", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-apiserver"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a"}, "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4a08bdfd-7c61-427b-95dd-b7fac0d1eefa", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "open-cluster-management-01a16895-b0c1-4fb6-88b5-e0497fd6a"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cloud-network-config-controller"}, "namespace": "openshift-cloud-network-config-controller", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "92d75128-49c1-4bd8-b952-b7c12ba11fb0", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cloud-network-config-controller"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-multus"}, "namespace": "openshift-multus", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b81220ae-ca18-4500-86b9-67036455d96e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-multus"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ovn-kubernetes"}, "namespace": "openshift-ovn-kubernetes", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "aa145447-5311-4fc5-9b25-b0c9a22de5cc", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ovn-kubernetes"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-dns-operator"}, "namespace": "openshift-dns-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "20dc7b38-d1d8-4af1-b10c-10c067bf185b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-dns-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-console-user-settings"}, "namespace": "openshift-console-user-settings", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c98f3612-5a2e-4201-b536-53ab7d502081", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-console-user-settings"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-apiserver-operator"}, "namespace": "openshift-apiserver-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "147ecacb-648f-4685-873c-1115770bc631", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-apiserver-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-config-operator"}, "namespace": "openshift-config-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "284248bd-38d5-431b-ba74-0ae16fc7210f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-config-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-insights"}, "namespace": "openshift-insights", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8cc59176-7603-4ba6-82cc-46e3ad031169", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-insights"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kube-node-lease"}, "namespace": "kube-node-lease", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3be9472a-8e4a-41cc-8864-0cfe01013cd5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kube-node-lease"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-authentication-operator"}, "namespace": "openshift-authentication-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "4fdd88a2-5606-4a5e-a196-be06f8fd7cff", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-authentication-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-node-identity"}, "namespace": "openshift-network-node-identity", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "d4a6690a-f0d0-4696-bb41-f9326d97377b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-node-identity"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-host-network"}, "namespace": "openshift-host-network", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8a377ed3-1990-4357-bf1b-ed89b467f569", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-host-network"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-scheduler"}, "namespace": "openshift-kube-scheduler", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "65977518-38cb-4734-8725-02e3a2a7f33e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-scheduler"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-service-ca"}, "namespace": "openshift-service-ca", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "697a3658-175f-4356-b39b-b109c7a50e2d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-service-ca"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-machine-approver"}, "namespace": "openshift-cluster-machine-approver", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "58664fb9-b0e5-4f7b-a13a-f6dbdf888023", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-machine-approver"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-console-operator"}, "namespace": "openshift-console-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f82bd2d7-69a9-4d74-8665-f576b399fe1d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-console-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kyverno"}, "namespace": "kyverno", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "74491c9b-4644-4d18-9286-2a8076a36805", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kyverno"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kube-storage-version-migrator"}, "namespace": "openshift-kube-storage-version-migrator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "003de290-3d00-452c-8490-51f38058af96", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kube-storage-version-migrator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-service-ca-operator"}, "namespace": "openshift-service-ca-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7cd95ceb-3cd1-468d-9592-4d01c8df5d02", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-service-ca-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-console"}, "namespace": "openshift-console", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "1d42a5f6-ae46-4b3d-baa5-d711a226d3a3", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-console"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"odh-model-registries"}, "namespace": "odh-model-registries", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9d473638-0036-4270-8097-0d9a18c3544b", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "odh-model-registries"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cloud-controller-manager"}, "namespace": "openshift-cloud-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7c42cb54-2cf0-4e77-b46f-e7a8ca799818", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cloud-controller-manager"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "bb5cd124-fcc0-4c34-a0ef-90b144f92077", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-monitoring"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-ingress-operator"}, "namespace": "openshift-ingress-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8e9ef2bb-de47-4320-82ae-aa384d2f14fd", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-ingress-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-controller-manager"}, "namespace": "openshift-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "de3cc143-ddbe-4899-882f-1dfc61f35f2c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-controller-manager"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"rhoai-model-registries"}, "namespace": "rhoai-model-registries", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "abd21362-32cc-4d86-874d-5eb856b1ecda", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "rhoai-model-registries"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-jobset-operator"}, "namespace": "openshift-jobset-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "501656e1-ebdf-4080-8a2f-ff4a9cea7ffc", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-jobset-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-authentication"}, "namespace": "openshift-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "54eaf2fa-6d66-43bb-ac24-b859eec440b1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-authentication"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-operator"}, "namespace": "openshift-network-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9f367600-3f5b-4432-a975-2d3e8bf72687", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-controller-manager-operator"}, "namespace": "openshift-controller-manager-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6eea959a-d1c9-445c-8540-494e5915d11e", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-controller-manager-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-dns"}, "namespace": "openshift-dns", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ac0cadc8-c246-45ae-bf9b-08a81a7fdfb1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-dns"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"kuadrant-system"}, "namespace": "kuadrant-system", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "99182a0b-a9c8-4881-84b1-8ae7f3952d4c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "kuadrant-system"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-csi-drivers"}, "namespace": "openshift-cluster-csi-drivers", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "0c768d5e-6c9e-4be1-83e8-605d896d4115", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-csi-drivers"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-kueue-operator"}, "namespace": "openshift-kueue-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3438a236-4335-4a3a-b0e3-f17e53adb091", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-kueue-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-machine-api"}, "namespace": "openshift-machine-api", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b10fc491-b45c-459d-95c4-3a9dc92a8633", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-machine-api"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"redhat-ods-monitoring"}, "namespace": "redhat-ods-monitoring", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a494b951-73bb-48ef-a746-532fe66c2dbc", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "redhat-ods-monitoring"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift"}, "namespace": "openshift", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "85db998e-82dc-486b-b44a-cb4e9c480922", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-lws-operator"}, "namespace": "openshift-lws-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c9ed20de-e6ab-4c9b-a54f-992895498d5d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-lws-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cloud-credential-operator"}, "namespace": "openshift-cloud-credential-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3a5c439c-72d2-4232-8855-1ea0f741249c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cloud-credential-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-network-console"}, "namespace": "openshift-network-console", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "efda210a-945b-442e-a335-08707e0fdf8f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-network-console"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-route-controller-manager"}, "namespace": "openshift-route-controller-manager", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "9b751f16-3b0b-4ef4-8c33-1438bf4d7aa9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-route-controller-manager"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-cluster-node-tuning-operator"}, "namespace": "openshift-cluster-node-tuning-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "df883768-5236-4f7f-a6d6-d602bbaed96a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-cluster-node-tuning-operator"} 2026-07-19T05:46:53Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openshift-machine-config-operator"}, "namespace": "openshift-machine-config-operator", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "58a14f47-0beb-4e7b-bb12-697c55d80580", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openshift-machine-config-operator"} 2026-07-19T05:46:58Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:58Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:58Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:58Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "ServingRuntime.serving.kserve.io", "error": "no matches for kind \"ServingRuntime\" in version \"serving.kserve.io/v1alpha1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:58Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "InferenceService.serving.kserve.io", "error": "no matches for kind \"InferenceService\" in version \"serving.kserve.io/v1beta1\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:58Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceService.serving.kserve.io", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:46:58Z ERROR controller-runtime.source.EventHandler if kind is a CRD, it should be installed before calling Start {"kind": "LLMInferenceServiceConfig.serving.kserve.io", "error": "no matches for kind \"LLMInferenceServiceConfig\" in version \"serving.kserve.io/v1alpha2\""} sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1.1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:71 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func2 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:87 k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/loop.go:88 k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/poll.go:33 sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind[...]).Start.func1 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/kind.go:64 2026-07-19T05:47:05Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Update /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:94 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnUpdate /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:125 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnUpdate /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:266 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1065 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:47:05Z ERROR Failed to list LLMInferenceServices for namespace label change {"namespace": "redhat-ods-applications", "error": "no matches for kind \"LLMInferenceService\" in version \"serving.kserve.io/v1alpha2\""} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/llm.(*GatewayReconciler).SetupWithManager.(*GatewayReconciler).enqueueGatewaysFromNamespace.func20 /workspace/internal/controller/serving/llm/gateway_controller.go:577 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).mapAndEnqueue /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:119 sigs.k8s.io/controller-runtime/pkg/handler.(*enqueueRequestsFromMapFunc[...]).Update /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/handler/enqueue_mapped.go:95 sigs.k8s.io/controller-runtime/pkg/internal/source.(*EventHandler[...]).OnUpdate /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/source/event_handler.go:125 k8s.io/client-go/tools/cache.ResourceEventHandlerFuncs.OnUpdate /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/controller.go:266 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1065 k8s.io/client-go/tools/cache.(*processorListener).run /cachi2/output/deps/gomod/pkg/mod/k8s.io/client-go@v0.34.3/tools/cache/shared_informer.go:1077 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /cachi2/output/deps/gomod/pkg/mod/k8s.io/apimachinery@v0.34.3/pkg/util/wait/wait.go:72 2026-07-19T05:47:08Z INFO Starting workers {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "worker count": 1} 2026-07-19T05:47:08Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-19T05:47:08Z INFO Multi Node reconciling. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-19T05:47:08Z INFO Starting workers {"controller": "llminferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "LLMInferenceService", "worker count": 1} 2026-07-19T05:47:08Z INFO Starting workers {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "worker count": 1} 2026-07-19T05:47:08Z INFO Starting workers {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "worker count": 1} 2026-07-19T05:47:13Z ERROR fail to get ray ca cert secret {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring", "secret": "ray-ca-tls", "namespace": "redhat-ods-applications", "error": "Secret \"ray-ca-tls\" not found"} github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*ServingRuntimeReconciler).reconcileMultiNodeSR /workspace/internal/controller/serving/servingruntime_controller.go:289 github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*ServingRuntimeReconciler).Reconcile /workspace/internal/controller/serving/servingruntime_controller.go:270 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:116 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:303 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T05:47:13Z ERROR Reconciler error {"controller": "servingruntime", "controllerGroup": "serving.kserve.io", "controllerKind": "ServingRuntime", "ServingRuntime": {"name":"openshift-monitoring","namespace":"openshift-monitoring"}, "namespace": "openshift-monitoring", "name": "openshift-monitoring", "reconcileID": "ac6948fe-4ce1-4b1e-a136-ce22e31cb400", "error": "Secret \"ray-ca-tls\" not found"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T05:47:13Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T05:47:13Z INFO Multi Node reconciling. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T05:47:14Z INFO ray ca tls secret modified so ray tls cert need to be updated to sync ca.crt {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T05:47:14Z INFO Multi Node reconciled successfully. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T05:47:14Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-19T05:47:14Z INFO Multi Node reconciling. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-19T05:47:16Z INFO Multi Node reconciled successfully. {"ResourceName": "openshift-monitoring", "Namespace": "openshift-monitoring"} 2026-07-19T05:52:11Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T05:52:11Z INFO Multi Node reconciling. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T05:52:17Z INFO ray ca tls secret modified so ray tls cert need to be updated to sync ca.crt {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T05:52:17Z INFO Multi Node reconciled successfully. {"ResourceName": "ray-ca-tls", "Namespace": "redhat-ods-applications"} 2026-07-19T06:01:35Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "5f72e342-961d-4e1d-8719-e31b4370b377", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:35Z INFO Creating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "5f72e342-961d-4e1d-8719-e31b4370b377", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:01:35Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "5f72e342-961d-4e1d-8719-e31b4370b377", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:35Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "0a84fb44-181a-493f-850b-64e1101d6ae7", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:35Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "0a84fb44-181a-493f-850b-64e1101d6ae7", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:01:35Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "0a84fb44-181a-493f-850b-64e1101d6ae7", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:35Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "ae30b812-51ed-448c-b773-99c4e9f76138", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:35Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "ae30b812-51ed-448c-b773-99c4e9f76138", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:01:36Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "ae30b812-51ed-448c-b773-99c4e9f76138", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:36Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "77d3431c-8019-4576-a3c0-d7259248d7ec", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:36Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "77d3431c-8019-4576-a3c0-d7259248d7ec", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:01:36Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "77d3431c-8019-4576-a3c0-d7259248d7ec", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:36Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "57855f97-38d9-40b5-ac1c-444efd6e0a1e", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:36Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "57855f97-38d9-40b5-ac1c-444efd6e0a1e", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:01:36Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "57855f97-38d9-40b5-ac1c-444efd6e0a1e", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:39Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "10e928b3-3041-49d5-9c0c-211e521e13a4", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:39Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "10e928b3-3041-49d5-9c0c-211e521e13a4", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:01:39Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "10e928b3-3041-49d5-9c0c-211e521e13a4", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:40Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "7f6e8f23-f0fe-4c09-8c7d-ca482ad45446", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:40Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "7f6e8f23-f0fe-4c09-8c7d-ca482ad45446", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:01:40Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "7f6e8f23-f0fe-4c09-8c7d-ca482ad45446", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "openshift-service-ca.crt", "reconcileID": "0667df63-5265-43f2-ae0e-06078b0d0831", "ConfigMap": "openshift-service-ca.crt", "namespace": "models-as-a-service"} 2026-07-19T06:01:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "openshift-service-ca.crt", "reconcileID": "aa5eec96-5052-4b77-b9fa-611082c1e13b", "ConfigMap": "openshift-service-ca.crt", "namespace": "models-as-a-service", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:01:43Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "openshift-service-ca.crt", "reconcileID": "aa5eec96-5052-4b77-b9fa-611082c1e13b", "ConfigMap": "openshift-service-ca.crt", "namespace": "models-as-a-service"} 2026-07-19T06:01:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "openshift-service-ca.crt", "reconcileID": "9dc6e8de-7d1f-456e-86cc-615734b9bfb5", "ConfigMap": "openshift-service-ca.crt", "namespace": "models-as-a-service", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:01:43Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "openshift-service-ca.crt", "reconcileID": "9dc6e8de-7d1f-456e-86cc-615734b9bfb5", "error": "configmaps \"odh-kserve-custom-ca-bundle\" already exists"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c416705d-1420-4152-a78f-5dd2d059306c", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "models-as-a-service"} 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "openshift-service-ca.crt", "reconcileID": "e39f6a27-a2ec-4e9b-a5e9-d3382c643b6a", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenants"} 2026-07-19T06:01:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "openshift-service-ca.crt", "reconcileID": "5aa5323f-dbe9-406c-8187-0a73764fefc3", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenants", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:01:43Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "openshift-service-ca.crt", "reconcileID": "5aa5323f-dbe9-406c-8187-0a73764fefc3", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenants"} 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "openshift-service-ca.crt", "reconcileID": "f0da4d7d-b371-4c17-9e6c-534dc9b14599", "ConfigMap": "openshift-service-ca.crt", "namespace": "models-as-a-service"} 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "ea2d4f9e-8552-4e27-b68b-87825f3320b1", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ai-tenants"} 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "openshift-service-ca.crt", "reconcileID": "51b343d9-8198-47d0-9e5f-afbc383c39fe", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenants"} 2026-07-19T06:01:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "odh-trusted-ca-bundle", "reconcileID": "d7eeb252-68e9-4bc5-a729-6080aadd4346", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "models-as-a-service", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:01:43Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "odh-trusted-ca-bundle", "reconcileID": "d7eeb252-68e9-4bc5-a729-6080aadd4346", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "models-as-a-service"} 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "032de0da-57d4-4e1a-b578-073e2fe7f3ba", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "models-as-a-service"} 2026-07-19T06:01:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "odh-trusted-ca-bundle", "reconcileID": "3f99e3d7-1af5-4396-9813-af43c71e76a2", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "models-as-a-service", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:01:43Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "odh-trusted-ca-bundle", "reconcileID": "3f99e3d7-1af5-4396-9813-af43c71e76a2", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "models-as-a-service"} 2026-07-19T06:01:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"models-as-a-service"}, "namespace": "models-as-a-service", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "26ae5f6f-32e6-4b58-b711-f146c4b551ef", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "models-as-a-service"} 2026-07-19T06:01:44Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "odh-trusted-ca-bundle", "reconcileID": "7561b4c3-cb3e-495c-ae1b-f34f8528696c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenants", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:01:44Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "odh-trusted-ca-bundle", "reconcileID": "7561b4c3-cb3e-495c-ae1b-f34f8528696c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenants"} 2026-07-19T06:01:44Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "856622e9-c74c-4413-9744-3f78ed3bfbe0", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ai-tenants"} 2026-07-19T06:01:44Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "odh-trusted-ca-bundle", "reconcileID": "0e10fce9-7776-42af-a78a-b6a0d9c07283", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenants", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:01:44Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "odh-trusted-ca-bundle", "reconcileID": "0e10fce9-7776-42af-a78a-b6a0d9c07283", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenants"} 2026-07-19T06:01:44Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ai-tenants"}, "namespace": "ai-tenants", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cf8e8e3a-45dc-4a9d-a275-53ec82a9f919", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ai-tenants"} 2026-07-19T06:02:14Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "26be3e1b-6586-4cb3-bc61-dbaeaa8610eb", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:02:14Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "26be3e1b-6586-4cb3-bc61-dbaeaa8610eb", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:02:14Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "26be3e1b-6586-4cb3-bc61-dbaeaa8610eb", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:02:14Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "openshift-service-ca.crt", "reconcileID": "94f99685-0864-4ab6-acf7-af2c8a3e2b12", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-applications"} 2026-07-19T06:02:15Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "42b5f4e9-ef36-4ec5-b7e8-56f971f85ea0", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:02:15Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "42b5f4e9-ef36-4ec5-b7e8-56f971f85ea0", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:02:15Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "42b5f4e9-ef36-4ec5-b7e8-56f971f85ea0", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:03:04Z DEBUG Reconciling EnvoyFilter for Gateway {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "621b5b38-6498-445d-9d27-8f68dc668ae0", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:03:04Z INFO Updating EnvoyFilter {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "621b5b38-6498-445d-9d27-8f68dc668ae0", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress", "name": "maas-default-gateway-authn-ssl"} 2026-07-19T06:03:04Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"maas-default-gateway","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "maas-default-gateway", "reconcileID": "621b5b38-6498-445d-9d27-8f68dc668ae0", "Gateway": "maas-default-gateway", "namespace": "openshift-ingress"} 2026-07-19T06:03:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "5a964cd7-b37f-46f1-b8f6-19b0c766b9b5", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap"} 2026-07-19T06:03:19Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-trusted-ca-bundle", "reconcileID": "937e9c05-497b-44ba-8d62-fd735cd43e12", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "openldap", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:03:19Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-trusted-ca-bundle", "reconcileID": "937e9c05-497b-44ba-8d62-fd735cd43e12", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "openldap"} 2026-07-19T06:03:19Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "9c327ff8-3127-4999-866a-85a575da6706", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:03:19Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "9c327ff8-3127-4999-866a-85a575da6706", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap"} 2026-07-19T06:03:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7837e835-3b61-429e-ad43-5efdf764db4a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openldap"} 2026-07-19T06:03:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"openldap"}, "namespace": "openldap", "name": "openshift-service-ca.crt", "reconcileID": "85a1fd18-e594-4a73-85c9-8a067953b895", "ConfigMap": "openshift-service-ca.crt", "namespace": "openldap"} 2026-07-19T06:03:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8eb98422-1fac-47b9-a9a5-703e333d1029", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openldap"} 2026-07-19T06:03:19Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-trusted-ca-bundle", "reconcileID": "a31b417b-2c90-4ef7-8898-66b454d10259", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "openldap", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:03:19Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-trusted-ca-bundle", "reconcileID": "a31b417b-2c90-4ef7-8898-66b454d10259", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "openldap"} 2026-07-19T06:03:19Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"openldap"}, "namespace": "openldap", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "f46452cb-45ff-4c11-b970-7b15ec15280a", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "openldap"} 2026-07-19T06:05:36Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "openshift-service-ca.crt", "reconcileID": "c85a0f1e-b6bc-4c8f-8c33-4c16da695cfb", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-trusted-ca-bundle", "reconcileID": "d95327a9-eab8-435e-a33e-8c6ea15aeef9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-kserve-raw-token-authentication", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:05:36Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-trusted-ca-bundle", "reconcileID": "d95327a9-eab8-435e-a33e-8c6ea15aeef9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "openshift-service-ca.crt", "reconcileID": "347996d2-ab47-4292-a896-04b89a41a854", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-kserve-raw-token-authentication", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:05:36Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "openshift-service-ca.crt", "reconcileID": "347996d2-ab47-4292-a896-04b89a41a854", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "146c60e3-27a1-4898-8241-2139b3f9eff4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:05:36Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "146c60e3-27a1-4898-8241-2139b3f9eff4", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "openshift-service-ca.crt", "reconcileID": "fb1d54a4-6876-4d04-916e-28e2b0d23312", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "942f7361-3e0f-4f4e-a36d-832868092efa", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-trusted-ca-bundle", "reconcileID": "562e532d-0c5f-45ee-b14d-7b7cf20c8efa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-kserve-raw-token-authentication", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:05:36Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-trusted-ca-bundle", "reconcileID": "562e532d-0c5f-45ee-b14d-7b7cf20c8efa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "02de1389-28eb-438c-bd0f-6d4e3e343c2d", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO Reconcile event triggered by serving runtime: http-mnist-runtime 2026-07-19T06:05:36Z INFO No InferenceServices found for Serving Runtime: http-mnist-runtime 2026-07-19T06:05:36Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "http-mnist-runtime", "Namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO Multi Node reconciling. {"ResourceName": "http-mnist-runtime", "Namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO Reconcile event triggered by Secret: ci-bucket-secret 2026-07-19T06:05:36Z INFO Creating Storage Config Secret {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-secret","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "ci-bucket-secret", "reconcileID": "5ec5bc75-ed82-411e-8f6d-05b97f90f8b8", "Secret": "ci-bucket-secret", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:05:36Z INFO Reconciling Storage Config Secret {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"models-bucket-secret","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "models-bucket-secret", "reconcileID": "00a3c063-6216-40b1-afb8-664d8332e08f", "Secret": "models-bucket-secret", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO Reconcile event triggered by Secret: models-bucket-secret 2026-07-19T06:05:36Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:05:36Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:05:36Z INFO inferenceservice-resource Defaulting for InferenceService {"name": "http-onnx", "name": "http-onnx"} 2026-07-19T06:05:36Z INFO inferenceservice-resource Validation for InferenceService upon creation {"namespace": "test-kserve-raw-token-authentication", "isvc": "http-onnx"} 2026-07-19T06:05:36Z INFO inferenceservice-resource Checking if namespace is protected {"namespace": "test-kserve-raw-token-authentication", "isvc": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "protectedNamespace": "redhat-ods-applications"} 2026-07-19T06:05:36Z INFO inferenceservice-resource Namespace is not protected {"namespace": "test-kserve-raw-token-authentication", "isvc": "http-onnx"} 2026-07-19T06:05:36Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO KubeAPIWarningLogger metadata.finalizers: "odh.inferenceservice.finalizers": prefer a domain-qualified finalizer name including a path (/) to avoid accidental conflicts with other finalizer writers 2026-07-19T06:05:36Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "create": "test-kserve-raw-token-authentication-models-bucket-sa-auth-delegator"} 2026-07-19T06:05:36Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z ERROR Failed to fetch service for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "InferenceService": "http-onnx"} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/reconcilers.(*KserveRawRouteReconciler).createDesiredResource /workspace/internal/controller/serving/reconcilers/kserve_raw_route_reconciler.go:110 github.com/opendatahub-io/odh-model-controller/internal/controller/serving/reconcilers.(*KserveRawRouteReconciler).Reconcile /workspace/internal/controller/serving/reconcilers/kserve_raw_route_reconciler.go:61 github.com/opendatahub-io/odh-model-controller/internal/controller/serving/reconcilers.(*KserveRawInferenceServiceReconciler).Reconcile /workspace/internal/controller/serving/reconcilers/kserve_raw_inferenceservice_reconciler.go:54 github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*InferenceServiceReconciler).ReconcileServing /workspace/internal/controller/serving/inferenceservice_controller.go:164 github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*InferenceServiceReconciler).Reconcile /workspace/internal/controller/serving/inferenceservice_controller.go:173 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:116 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:303 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:05:36Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx-metrics"} 2026-07-19T06:05:36Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG ServiceMonitor not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx-metrics"} 2026-07-19T06:05:36Z DEBUG ConfigMap not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx-metrics-dashboard"} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:36Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:36Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "0353d387-c353-4c61-8c86-ce030e632769", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:36Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx"} 2026-07-19T06:05:37Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:05:37Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "84be29d5-fb0f-4c9d-a839-d4bc82890f53", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:05:37Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:05:37Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "cb6a37ff-7b70-4704-ab71-326e22a90eb8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:05:37Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:05:37Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6744053b-7936-40b1-994b-7a064dbe902b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:38Z INFO Multi Node reconciled successfully. {"ResourceName": "http-mnist-runtime", "Namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:05:41Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:05:41Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:41Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:41Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6f7711c7-0b6b-473e-a7bc-4a6e9470dfb9", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:05:43Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:05:43Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:05:43Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:05:43Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "9dd600c3-d9d3-4231-9341-3d02d52c312a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:20Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:20Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:20Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:20Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "1c82411f-4e44-4dac-86dc-9bb66931eeec", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "delete": "test-kserve-raw-token-authentication-models-bucket-sa-auth-delegator"} 2026-07-19T06:06:28Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:28Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "5d5bf141-f15a-418e-b3f3-7e8284b6a2b3", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:28Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "86aff8a1-3a24-46d5-ae3e-c3e958ba32ed", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:28Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "91a1c02b-d919-4269-ba6b-36027e4cabde", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:28Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "03192f54-825e-4cb6-9af2-63417fa5f4a8", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:28Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "dccc7999-3e8b-4a9b-ad32-42f4f61116dc", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:28Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:28Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:28Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "d3a8604e-5087-4083-95e9-51bec4613360", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:30Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:30Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:30Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:30Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "99e81b65-d78b-4c30-8442-df96abcf03ee", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:31Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:31Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:31Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:31Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "929527a9-8278-41cc-b7e9-14dab064f6d4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "create": "test-kserve-raw-token-authentication-models-bucket-sa-auth-delegator"} 2026-07-19T06:06:33Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:33Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8143815b-ad54-4bb3-a5eb-dabd3ab0ef45", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:33Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "8b4f5164-6712-4a0f-b064-58c1ee52671b", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:33Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6864276e-0b8d-4bcc-9db3-09509714a811", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:33Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "00b12718-4f7d-4f20-bebf-47e8fc5ef764", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-metrics-dashboard"} 2026-07-19T06:06:33Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:33Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:33Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "92d11f10-808f-4216-ba6e-65aa2314498a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO inferenceservice-resource Defaulting for InferenceService {"name": "http-onnx-2", "name": "http-onnx-2"} 2026-07-19T06:06:35Z INFO inferenceservice-resource Validation for InferenceService upon creation {"namespace": "test-kserve-raw-token-authentication", "isvc": "http-onnx-2"} 2026-07-19T06:06:35Z INFO inferenceservice-resource Checking if namespace is protected {"namespace": "test-kserve-raw-token-authentication", "isvc": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "protectedNamespace": "redhat-ods-applications"} 2026-07-19T06:06:35Z INFO inferenceservice-resource Namespace is not protected {"namespace": "test-kserve-raw-token-authentication", "isvc": "http-onnx-2"} 2026-07-19T06:06:35Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "create": "test-kserve-raw-token-authentication-models-bucket-sa-2-auth-delegator"} 2026-07-19T06:06:35Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z ERROR Failed to fetch service for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "InferenceService": "http-onnx-2"} github.com/opendatahub-io/odh-model-controller/internal/controller/serving/reconcilers.(*KserveRawRouteReconciler).createDesiredResource /workspace/internal/controller/serving/reconcilers/kserve_raw_route_reconciler.go:110 github.com/opendatahub-io/odh-model-controller/internal/controller/serving/reconcilers.(*KserveRawRouteReconciler).Reconcile /workspace/internal/controller/serving/reconcilers/kserve_raw_route_reconciler.go:61 github.com/opendatahub-io/odh-model-controller/internal/controller/serving/reconcilers.(*KserveRawInferenceServiceReconciler).Reconcile /workspace/internal/controller/serving/reconcilers/kserve_raw_inferenceservice_reconciler.go:54 github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*InferenceServiceReconciler).ReconcileServing /workspace/internal/controller/serving/inferenceservice_controller.go:164 github.com/opendatahub-io/odh-model-controller/internal/controller/serving.(*InferenceServiceReconciler).Reconcile /workspace/internal/controller/serving/inferenceservice_controller.go:173 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:116 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:303 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:06:35Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx-2-metrics"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG ServiceMonitor not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx-2-metrics"} 2026-07-19T06:06:35Z DEBUG ConfigMap not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5d068cec-dd00-40cd-8ebb-8b224476a092", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "create": "http-onnx-2"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:35Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5f3c6afe-6162-43c2-a642-7cd1022d3a76", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx-2"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:35Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "f45cf5f6-e3c0-4a90-8bbe-9179988ff869", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx-2"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:35Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9e6746bc-e690-4123-bbbf-5582e3ebc22e", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx-2"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:35Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:35Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "2d6c5af8-6f11-4512-802c-b6b96f11ba05", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx-2"} 2026-07-19T06:06:36Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:36Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:36Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:36Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "9c19f574-11f3-48e2-b770-5541230e9c9f", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx-2"} 2026-07-19T06:06:38Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:38Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:38Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:38Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "6a37fd7a-6daa-4fbf-83d2-4c65586f76d7", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Successfully fetch deployed ClusterRoleBinding {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Successfully fetch deployed Openshift Route {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "update": "http-onnx-2"} 2026-07-19T06:06:47Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "ConfigMap:": "http-onnx-2-metrics-dashboard"} 2026-07-19T06:06:47Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:47Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:47Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "752f8101-d832-4246-8424-4bd1c033dc68", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2"} 2026-07-19T06:06:56Z DEBUG Deleting ClusterRoleBinding test-kserve-raw-token-authentication-models-bucket-sa-2-auth-delegator in namespace test-kserve-raw-token-authentication {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:56Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1d915e30-6185-4d9b-91df-d028dc7e2f8a", "error": "InferenceService.serving.kserve.io \"http-onnx-2\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"inferenceservice.finalizers\"}"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:06:56Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2"} 2026-07-19T06:06:56Z DEBUG Deleting ClusterRoleBinding test-kserve-raw-token-authentication-models-bucket-sa-2-auth-delegator in namespace test-kserve-raw-token-authentication {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:56Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "1003a18a-6794-4b37-877a-e36635d25a38", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2"} 2026-07-19T06:06:56Z DEBUG Deleting ClusterRoleBinding test-kserve-raw-token-authentication-models-bucket-sa-2-auth-delegator in namespace test-kserve-raw-token-authentication {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:56Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:56Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "0ba0be0e-068f-4612-a294-92d31ff732db", "error": "inferenceservices.serving.kserve.io \"http-onnx-2\" not found"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:06:56Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "664f205d-d663-4d0b-a457-b0dc7caf9af0", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "3438569e-ed65-4a46-9668-cde928cffd32", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:56Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-2","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx-2", "reconcileID": "5226a6bb-a6da-4acb-9c59-72da849c6910", "InferenceService": "http-onnx-2", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx"} 2026-07-19T06:06:57Z DEBUG Deleting ClusterRoleBinding test-kserve-raw-token-authentication-models-bucket-sa-auth-delegator in namespace test-kserve-raw-token-authentication {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "c0cc49bf-aca9-456e-8eef-f1aef57c48d0", "error": "InferenceService.serving.kserve.io \"http-onnx\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"inferenceservice.finalizers\"}"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:06:57Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx"} 2026-07-19T06:06:57Z DEBUG Deleting ClusterRoleBinding test-kserve-raw-token-authentication-models-bucket-sa-auth-delegator in namespace test-kserve-raw-token-authentication {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "autoscaling": null} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "ae58325f-7b20-4010-9993-d884c29f7ade", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx"} 2026-07-19T06:06:57Z DEBUG Deleting ClusterRoleBinding test-kserve-raw-token-authentication-models-bucket-sa-auth-delegator in namespace test-kserve-raw-token-authentication {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-kserve-raw-token-authentication", "name": "inference-prometheus-auth"} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "11634e72-5886-497a-a5d4-652babfe67e4", "error": "inferenceservices.serving.kserve.io \"http-onnx\" not found"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:06:57Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "936b5fb1-d60f-439c-9584-e8fe24e9946a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "936b5fb1-d60f-439c-9584-e8fe24e9946a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "936b5fb1-d60f-439c-9584-e8fe24e9946a", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6363fc1e-9b88-4cf4-9a8d-c453a1b0b987", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6363fc1e-9b88-4cf4-9a8d-c453a1b0b987", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:57Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "http-onnx", "reconcileID": "6363fc1e-9b88-4cf4-9a8d-c453a1b0b987", "InferenceService": "http-onnx", "namespace": "test-kserve-raw-token-authentication", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO Reconcile event triggered by Secret: models-bucket-secret 2026-07-19T06:06:58Z INFO Data Connection not found {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"models-bucket-secret","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "models-bucket-secret", "reconcileID": "97c8a66a-e248-4210-a7f4-60a85d995f13", "Secret": "models-bucket-secret", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO Reconciling Storage Config Secret {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"models-bucket-secret","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "models-bucket-secret", "reconcileID": "97c8a66a-e248-4210-a7f4-60a85d995f13", "Secret": "models-bucket-secret", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:06:58Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:06:58Z INFO Reconcile event triggered by Secret: ci-bucket-secret 2026-07-19T06:06:58Z INFO Data Connection not found {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-secret","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "ci-bucket-secret", "reconcileID": "6f103b04-b0e5-435c-9960-2361e6cfd6ae", "Secret": "ci-bucket-secret", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO No data connections found in namespace {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-secret","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "ci-bucket-secret", "reconcileID": "6f103b04-b0e5-435c-9960-2361e6cfd6ae", "Secret": "ci-bucket-secret", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO Deleting StorageSecret {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-secret","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "ci-bucket-secret", "reconcileID": "6f103b04-b0e5-435c-9960-2361e6cfd6ae", "Secret": "ci-bucket-secret", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:06:58Z INFO Data Connection not found {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"storage-config","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "storage-config", "reconcileID": "e774f528-7ac2-4168-91f4-3083917c49ce", "Secret": "storage-config", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO No data connections found in namespace {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"storage-config","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "storage-config", "reconcileID": "e774f528-7ac2-4168-91f4-3083917c49ce", "Secret": "storage-config", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO Reconcile event triggered by serving runtime: http-mnist-runtime 2026-07-19T06:06:58Z INFO No InferenceServices found for Serving Runtime: http-mnist-runtime 2026-07-19T06:06:58Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "http-mnist-runtime", "Namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:58Z INFO Multi Node reconciling. {"ResourceName": "http-mnist-runtime", "Namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:06:59Z INFO Multi Node reconciled successfully. {"ResourceName": "http-mnist-runtime", "Namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "73cc6bde-87d4-4baf-b0b5-f26f004a8b94", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "73cc6bde-87d4-4baf-b0b5-f26f004a8b94", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:07:04Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "73cc6bde-87d4-4baf-b0b5-f26f004a8b94", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-kserve-raw-token-authentication because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:07:04Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-trusted-ca-bundle", "reconcileID": "fecf8c1f-91fb-4b57-8f53-e8eced0e8006", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-trusted-ca-bundle", "reconcileID": "fecf8c1f-91fb-4b57-8f53-e8eced0e8006", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "openshift-service-ca.crt", "reconcileID": "93b8d3e3-7578-4e9d-b974-8a6a18cc7e41", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "openshift-service-ca.crt", "reconcileID": "93b8d3e3-7578-4e9d-b974-8a6a18cc7e41", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "29ca2060-d309-49f1-a806-914dbdcf12b8", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-kserve-raw-token-authentication"}, "namespace": "test-kserve-raw-token-authentication", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "29ca2060-d309-49f1-a806-914dbdcf12b8", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-kserve-raw-token-authentication"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "openshift-service-ca.crt", "reconcileID": "c4938c8f-b8ff-407b-b858-0263da1090c5", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-trusted-ca-bundle", "reconcileID": "9a00239d-e96f-4ddb-a1aa-50c3cd00a150", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-non-admin-raw", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:07:04Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-trusted-ca-bundle", "reconcileID": "9a00239d-e96f-4ddb-a1aa-50c3cd00a150", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "openshift-service-ca.crt", "reconcileID": "a168e42a-0676-4f3a-b395-ad8db9787d30", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-non-admin-raw", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:07:04Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "openshift-service-ca.crt", "reconcileID": "a168e42a-0676-4f3a-b395-ad8db9787d30", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "08927b07-7b97-4758-9e5c-8ad978b9f550", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:07:04Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "08927b07-7b97-4758-9e5c-8ad978b9f550", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "openshift-service-ca.crt", "reconcileID": "3df90d0b-5ab2-44e0-a789-4c1d9e8c11e8", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "007b0ab6-9abe-4d43-9feb-c42b4e8dc565", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Reconcile event triggered by serving runtime: http-mnist-runtime 2026-07-19T06:07:04Z INFO No InferenceServices found for Serving Runtime: http-mnist-runtime 2026-07-19T06:07:04Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "http-mnist-runtime", "Namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Multi Node reconciling. {"ResourceName": "http-mnist-runtime", "Namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Reconcile event triggered by Secret: ci-bucket-unprivileged 2026-07-19T06:07:04Z INFO Creating Storage Config Secret {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-unprivileged","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "ci-bucket-unprivileged", "reconcileID": "a3a67bc7-19dd-4678-9741-1438ec026a79", "Secret": "ci-bucket-unprivileged", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:07:04Z INFO inferenceservice-resource Defaulting for InferenceService {"name": "http-onnx-raw", "name": "http-onnx-raw"} 2026-07-19T06:07:04Z INFO inferenceservice-resource Validation for InferenceService upon creation {"namespace": "test-non-admin-raw", "isvc": "http-onnx-raw"} 2026-07-19T06:07:04Z INFO inferenceservice-resource Checking if namespace is protected {"namespace": "test-non-admin-raw", "isvc": "http-onnx-raw", "namespace": "test-non-admin-raw", "protectedNamespace": "redhat-ods-applications"} 2026-07-19T06:07:04Z INFO inferenceservice-resource Namespace is not protected {"namespace": "test-non-admin-raw", "isvc": "http-onnx-raw"} 2026-07-19T06:07:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "create": "http-onnx-raw-metrics"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG ServiceMonitor not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "create": "http-onnx-raw-metrics"} 2026-07-19T06:07:04Z DEBUG ConfigMap not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "create": "http-onnx-raw-metrics-dashboard"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "933301a2-c33a-4caf-bae3-b6828e1cb5c4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "ConfigMap:": "http-onnx-raw-metrics-dashboard"} 2026-07-19T06:07:04Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "f3102e2b-6167-4d2c-b3de-7bec24658916", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "ConfigMap:": "http-onnx-raw-metrics-dashboard"} 2026-07-19T06:07:04Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "435ca89d-d841-45e5-8a43-5dd550354b98", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "ConfigMap:": "http-onnx-raw-metrics-dashboard"} 2026-07-19T06:07:04Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "72ea4292-f475-46a7-ac9a-222bdd28d1f2", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:05Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-trusted-ca-bundle", "reconcileID": "854414f6-6b34-425e-a8cc-882d588bf9ba", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-non-admin-raw", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:07:05Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:07:05Z INFO Data Connection not found {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"storage-config","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "storage-config", "reconcileID": "4ebf987f-d6c0-42c3-b35e-d8d9be8cc09a", "Secret": "storage-config", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:05Z INFO Creating Storage Config Secret {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"storage-config","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "storage-config", "reconcileID": "4ebf987f-d6c0-42c3-b35e-d8d9be8cc09a", "Secret": "storage-config", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:05Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-trusted-ca-bundle", "reconcileID": "854414f6-6b34-425e-a8cc-882d588bf9ba", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:05Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "3985d872-c9f9-47ee-a599-f56c2dbde5f7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:05Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:07:06Z INFO Multi Node reconciled successfully. {"ResourceName": "http-mnist-runtime", "Namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "ConfigMap:": "http-onnx-raw-metrics-dashboard"} 2026-07-19T06:07:06Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:06Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:06Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "04ce00ba-cc91-4898-a791-cb5704d03157", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "ConfigMap:": "http-onnx-raw-metrics-dashboard"} 2026-07-19T06:07:07Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:07Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:07Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "75f2ab4f-f710-4ea0-869e-2a16e1226f62", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "ConfigMap:": "http-onnx-raw-metrics-dashboard"} 2026-07-19T06:07:16Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:16Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "6eb8ecbf-dd27-4015-9cf4-7be2d22826b4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "name": "http-onnx-raw"} 2026-07-19T06:07:26Z DEBUG Deleting ClusterRoleBinding test-non-admin-raw-default-auth-delegator in namespace test-non-admin-raw {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "30eddbf8-7042-49ab-ba30-36643aa710e4", "error": "InferenceService.serving.kserve.io \"http-onnx-raw\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"inferenceservice.finalizers\"}"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:07:26Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "name": "http-onnx-raw"} 2026-07-19T06:07:26Z DEBUG Deleting ClusterRoleBinding test-non-admin-raw-default-auth-delegator in namespace test-non-admin-raw {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "347df0ed-bb58-44b7-9b59-6d74c2bf2f49", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "name": "http-onnx-raw"} 2026-07-19T06:07:26Z DEBUG Deleting ClusterRoleBinding test-non-admin-raw-default-auth-delegator in namespace test-non-admin-raw {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "test-non-admin-raw", "name": "inference-prometheus-auth"} 2026-07-19T06:07:26Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "autoscaling": null} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55f35f5e-d8ec-4821-9022-f2496aa6480c", "error": "inferenceservices.serving.kserve.io \"http-onnx-raw\" not found"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:07:26Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "aabd5f0d-a441-44c4-b9d0-06192c5d574a", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "aabd5f0d-a441-44c4-b9d0-06192c5d574a", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "aabd5f0d-a441-44c4-b9d0-06192c5d574a", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55bb2978-7ed6-4b27-943d-a7218b1dfe1d", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55bb2978-7ed6-4b27-943d-a7218b1dfe1d", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"http-onnx-raw","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "http-onnx-raw", "reconcileID": "55bb2978-7ed6-4b27-943d-a7218b1dfe1d", "InferenceService": "http-onnx-raw", "namespace": "test-non-admin-raw", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:27Z INFO Data Connection not found {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-unprivileged","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "ci-bucket-unprivileged", "reconcileID": "e5a3568d-1a9c-4929-8f0b-81f5b6dce6ee", "Secret": "ci-bucket-unprivileged", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:27Z INFO No data connections found in namespace {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-unprivileged","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "ci-bucket-unprivileged", "reconcileID": "e5a3568d-1a9c-4929-8f0b-81f5b6dce6ee", "Secret": "ci-bucket-unprivileged", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:27Z INFO Deleting StorageSecret {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"ci-bucket-unprivileged","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "ci-bucket-unprivileged", "reconcileID": "e5a3568d-1a9c-4929-8f0b-81f5b6dce6ee", "Secret": "ci-bucket-unprivileged", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:27Z INFO Reconcile event triggered by Secret: ci-bucket-unprivileged 2026-07-19T06:07:27Z INFO Reconcile event triggered by Secret: storage-config 2026-07-19T06:07:27Z INFO Data Connection not found {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"storage-config","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "storage-config", "reconcileID": "e3915118-1dc5-41d5-8aba-ec5655f3185e", "Secret": "storage-config", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:27Z INFO No data connections found in namespace {"controller": "secret", "controllerGroup": "", "controllerKind": "Secret", "Secret": {"name":"storage-config","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "storage-config", "reconcileID": "e3915118-1dc5-41d5-8aba-ec5655f3185e", "Secret": "storage-config", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:27Z INFO Reconcile event triggered by serving runtime: http-mnist-runtime 2026-07-19T06:07:27Z INFO No InferenceServices found for Serving Runtime: http-mnist-runtime 2026-07-19T06:07:27Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "http-mnist-runtime", "Namespace": "test-non-admin-raw"} 2026-07-19T06:07:27Z INFO Multi Node reconciling. {"ResourceName": "http-mnist-runtime", "Namespace": "test-non-admin-raw"} 2026-07-19T06:07:28Z INFO Multi Node reconciled successfully. {"ResourceName": "http-mnist-runtime", "Namespace": "test-non-admin-raw"} 2026-07-19T06:07:33Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "927df538-7667-48dc-a2b4-aac9f7d60041", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:33Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "927df538-7667-48dc-a2b4-aac9f7d60041", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:07:33Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "927df538-7667-48dc-a2b4-aac9f7d60041", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace test-non-admin-raw because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:07:33Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-trusted-ca-bundle", "reconcileID": "bbcd5092-6f34-4bd4-b2c6-2265096b7416", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:33Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-trusted-ca-bundle", "reconcileID": "bbcd5092-6f34-4bd4-b2c6-2265096b7416", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:33Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "openshift-service-ca.crt", "reconcileID": "8a036050-844f-4179-9693-efd40f764e05", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:33Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "openshift-service-ca.crt", "reconcileID": "8a036050-844f-4179-9693-efd40f764e05", "ConfigMap": "openshift-service-ca.crt", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:33Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b34434f0-a23e-4307-a04a-7d00918e46ed", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:07:33Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"test-non-admin-raw"}, "namespace": "test-non-admin-raw", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b34434f0-a23e-4307-a04a-7d00918e46ed", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "test-non-admin-raw"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "openshift-service-ca.crt", "reconcileID": "db2e8eee-f393-4cbc-be9b-8c7446e0400e", "ConfigMap": "openshift-service-ca.crt", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-trusted-ca-bundle", "reconcileID": "3dc8c688-989a-460c-846b-1cca57ca5ae8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "onnx-standard-rest", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:04Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-trusted-ca-bundle", "reconcileID": "3dc8c688-989a-460c-846b-1cca57ca5ae8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "openshift-service-ca.crt", "reconcileID": "9f8a05ef-cf9c-4abe-a9a5-42e38ff7d42d", "ConfigMap": "openshift-service-ca.crt", "namespace": "onnx-standard-rest", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:04Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "openshift-service-ca.crt", "reconcileID": "9f8a05ef-cf9c-4abe-a9a5-42e38ff7d42d", "error": "configmaps \"odh-kserve-custom-ca-bundle\" already exists"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:08:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a3088d04-4eea-45e1-a6ef-d77fefcfeb49", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:04Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a3088d04-4eea-45e1-a6ef-d77fefcfeb49", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "openshift-service-ca.crt", "reconcileID": "67bc51a8-7071-462b-b1fd-2d1f87a7e942", "ConfigMap": "openshift-service-ca.crt", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "350e08db-4162-4c1b-8b4b-7dac8ce36b95", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-trusted-ca-bundle", "reconcileID": "b5f84ba3-5e74-4c81-b186-9a146b967a60", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "onnx-standard-rest", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:04Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-trusted-ca-bundle", "reconcileID": "b5f84ba3-5e74-4c81-b186-9a146b967a60", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c460e2c3-883a-4b70-b545-e3601001c59f", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Reconcile event triggered by serving runtime: openvino-runtime 2026-07-19T06:08:04Z INFO No InferenceServices found for Serving Runtime: openvino-runtime 2026-07-19T06:08:04Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "openvino-runtime", "Namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Multi Node reconciling. {"ResourceName": "openvino-runtime", "Namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO inferenceservice-resource Defaulting for InferenceService {"name": "onnx", "name": "onnx"} 2026-07-19T06:08:04Z INFO inferenceservice-resource Validation for InferenceService upon creation {"namespace": "onnx-standard-rest", "isvc": "onnx"} 2026-07-19T06:08:04Z INFO inferenceservice-resource Checking if namespace is protected {"namespace": "onnx-standard-rest", "isvc": "onnx", "namespace": "onnx-standard-rest", "protectedNamespace": "redhat-ods-applications"} 2026-07-19T06:08:04Z INFO inferenceservice-resource Namespace is not protected {"namespace": "onnx-standard-rest", "isvc": "onnx"} 2026-07-19T06:08:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "create": "onnx-metrics"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG ServiceMonitor not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "create": "onnx-metrics"} 2026-07-19T06:08:04Z DEBUG ConfigMap not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "create": "onnx-metrics-dashboard"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "25d0a021-3449-4b54-918b-3231c3f9df92", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "ConfigMap:": "onnx-metrics-dashboard"} 2026-07-19T06:08:04Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "4a9d5dd0-bf33-4c0c-8cdb-b2183497cbf4", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "ConfigMap:": "onnx-metrics-dashboard"} 2026-07-19T06:08:04Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "f60cb1af-a2f0-40ba-8b5a-26d5288def18", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "ConfigMap:": "onnx-metrics-dashboard"} 2026-07-19T06:08:04Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "034644d3-c5ad-4a42-be18-1ce83428635d", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "ConfigMap:": "onnx-metrics-dashboard"} 2026-07-19T06:08:05Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "e2d5d1f6-cae5-4a15-9618-6e5f5f28401a", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z INFO Multi Node reconciled successfully. {"ResourceName": "openvino-runtime", "Namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "ConfigMap:": "onnx-metrics-dashboard"} 2026-07-19T06:08:05Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:05Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "560b7617-cf79-42e6-8a76-8ceb9c38d26f", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "ConfigMap:": "onnx-metrics-dashboard"} 2026-07-19T06:08:07Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:07Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:07Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "79de0859-f467-4bd5-85b3-2a15edd330fe", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Successfully fetch deployed Service {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "ConfigMap:": "onnx-metrics-dashboard"} 2026-07-19T06:08:15Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:15Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:15Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "985f99a9-fc69-4f56-a721-9821ea9c8a09", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "name": "onnx"} 2026-07-19T06:08:16Z DEBUG Deleting ClusterRoleBinding onnx-standard-rest-openvino-models-bucket-sa-auth-delegator in namespace onnx-standard-rest {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "486c94fa-03df-464b-a5da-5aaf31606837", "error": "InferenceService.serving.kserve.io \"onnx\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"inferenceservice.finalizers\"}"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:08:16Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "name": "onnx"} 2026-07-19T06:08:16Z DEBUG Deleting ClusterRoleBinding onnx-standard-rest-openvino-models-bucket-sa-auth-delegator in namespace onnx-standard-rest {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "eb3f1f46-b399-49bf-b159-a7840b216246", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "name": "onnx"} 2026-07-19T06:08:16Z DEBUG Deleting ClusterRoleBinding onnx-standard-rest-openvino-models-bucket-sa-auth-delegator in namespace onnx-standard-rest {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "onnx-standard-rest", "name": "inference-prometheus-auth"} 2026-07-19T06:08:16Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "autoscaling": null} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "987099f3-fd90-46c6-86c4-9cc6525fb961", "error": "inferenceservices.serving.kserve.io \"onnx\" not found"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:08:16Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "b437084d-fcb0-4fc1-a12f-763816ebb7ef", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "b437084d-fcb0-4fc1-a12f-763816ebb7ef", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "b437084d-fcb0-4fc1-a12f-763816ebb7ef", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "9c9b4cbc-ce97-4661-8517-786d65e738da", "InferenceService": "onnx", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "9c9b4cbc-ce97-4661-8517-786d65e738da", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:16Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"onnx","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "onnx", "reconcileID": "9c9b4cbc-ce97-4661-8517-786d65e738da", "InferenceService": "onnx", "namespace": "onnx-standard-rest", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:17Z INFO Reconcile event triggered by serving runtime: openvino-runtime 2026-07-19T06:08:17Z INFO No InferenceServices found for Serving Runtime: openvino-runtime 2026-07-19T06:08:17Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "openvino-runtime", "Namespace": "onnx-standard-rest"} 2026-07-19T06:08:17Z INFO Multi Node reconciling. {"ResourceName": "openvino-runtime", "Namespace": "onnx-standard-rest"} 2026-07-19T06:08:17Z INFO Multi Node reconciled successfully. {"ResourceName": "openvino-runtime", "Namespace": "onnx-standard-rest"} 2026-07-19T06:08:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "752fed24-4205-41b8-ad67-e38f4f8e3566", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:22Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "752fed24-4205-41b8-ad67-e38f4f8e3566", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:22Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "752fed24-4205-41b8-ad67-e38f4f8e3566", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace onnx-standard-rest because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:08:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-trusted-ca-bundle", "reconcileID": "4d781071-e624-4671-9c7a-c50b026ef25c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-trusted-ca-bundle", "reconcileID": "4d781071-e624-4671-9c7a-c50b026ef25c", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "openshift-service-ca.crt", "reconcileID": "17f021a7-024d-4a41-aa7c-d1dbe13d29a2", "ConfigMap": "openshift-service-ca.crt", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "openshift-service-ca.crt", "reconcileID": "17f021a7-024d-4a41-aa7c-d1dbe13d29a2", "ConfigMap": "openshift-service-ca.crt", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:22Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2415d5d9-ff92-449e-a04f-69b47cda6049", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:22Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"onnx-standard-rest"}, "namespace": "onnx-standard-rest", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "2415d5d9-ff92-449e-a04f-69b47cda6049", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "onnx-standard-rest"} 2026-07-19T06:08:23Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "openshift-service-ca.crt", "reconcileID": "e6183d14-86de-4544-ba87-b768a5264cf9", "ConfigMap": "openshift-service-ca.crt", "namespace": "ovms-smoke", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:23Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "openshift-service-ca.crt", "reconcileID": "e6183d14-86de-4544-ba87-b768a5264cf9", "ConfigMap": "openshift-service-ca.crt", "namespace": "ovms-smoke"} 2026-07-19T06:08:23Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-trusted-ca-bundle", "reconcileID": "860112cc-3d29-4d18-a8dc-2bc686740de8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ovms-smoke", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:23Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-trusted-ca-bundle", "reconcileID": "860112cc-3d29-4d18-a8dc-2bc686740de8", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:08:23Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b7975011-dd5c-46a1-ae39-323673f6df29", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:23Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "b7975011-dd5c-46a1-ae39-323673f6df29", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:08:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "openshift-service-ca.crt", "reconcileID": "6ecd6ba3-a604-4563-9d95-26fd31792a22", "ConfigMap": "openshift-service-ca.crt", "namespace": "ovms-smoke"} 2026-07-19T06:08:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "c1d0e9c5-a4ba-4b43-890a-1ee7b348efbb", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:08:23Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-trusted-ca-bundle", "reconcileID": "6ba01733-3893-45ce-9592-1b59fd562db7", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ovms-smoke", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:08:23Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-trusted-ca-bundle", "reconcileID": "6ba01733-3893-45ce-9592-1b59fd562db7", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:08:23Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "13574615-ac22-4283-b153-784294ff83ea", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fff14a50-86fb-491f-a6c3-3a46b4bb99b9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fff14a50-86fb-491f-a6c3-3a46b4bb99b9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:09:00Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "fff14a50-86fb-491f-a6c3-3a46b4bb99b9", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace ovms-smoke because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:09:00Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-trusted-ca-bundle", "reconcileID": "60a419e4-9096-4e42-916b-7c252c5e638d", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-trusted-ca-bundle", "reconcileID": "60a419e4-9096-4e42-916b-7c252c5e638d", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "openshift-service-ca.crt", "reconcileID": "c6198640-e7a7-421d-90d5-f1e95ac4808f", "ConfigMap": "openshift-service-ca.crt", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "openshift-service-ca.crt", "reconcileID": "c6198640-e7a7-421d-90d5-f1e95ac4808f", "ConfigMap": "openshift-service-ca.crt", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a9d981fd-95e8-47e2-be7e-983fcf320999", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ovms-smoke"}, "namespace": "ovms-smoke", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "a9d981fd-95e8-47e2-be7e-983fcf320999", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ovms-smoke"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "1d2d6ced-3e20-49e0-a42c-a3717d32e5ea", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "a130f592-a8eb-469b-ac68-2e47abbea9f9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:09:00Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "a130f592-a8eb-469b-ac68-2e47abbea9f9", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "d31dc383-98c0-431d-b53f-d20e891281c1", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:09:00Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "d31dc383-98c0-431d-b53f-d20e891281c1", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "acb843b1-c221-47bc-b3fe-34105a0387f7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "cb655f93-4c1c-4715-9946-ffad60b3993f", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "a2f9352f-fb57-4384-9e1d-97750b64f984", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:09:00Z INFO Reconcile event triggered by serving runtime: triton-grpc-runtime 2026-07-19T06:09:00Z INFO No InferenceServices found for Serving Runtime: triton-grpc-runtime 2026-07-19T06:09:00Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "triton-grpc-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z INFO Multi Node reconciling. {"ResourceName": "triton-grpc-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "a2f9352f-fb57-4384-9e1d-97750b64f984", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "93043579-9c1c-4dc3-a8fb-dbfefc616410", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z INFO inferenceservice-resource Defaulting for InferenceService {"name": "tensorflow-standard-grpc", "name": "tensorflow-standard-grpc"} 2026-07-19T06:09:00Z INFO inferenceservice-resource Validation for InferenceService upon creation {"namespace": "tensorflow-standard", "isvc": "tensorflow-standard-grpc"} 2026-07-19T06:09:00Z INFO inferenceservice-resource Checking if namespace is protected {"namespace": "tensorflow-standard", "isvc": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "protectedNamespace": "redhat-ods-applications"} 2026-07-19T06:09:00Z INFO inferenceservice-resource Namespace is not protected {"namespace": "tensorflow-standard", "isvc": "tensorflow-standard-grpc"} 2026-07-19T06:09:00Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG ServiceMonitor not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "create": "tensorflow-standard-grpc-metrics"} 2026-07-19T06:09:00Z DEBUG ConfigMap not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:00Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "create": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "24ed0f6c-66b9-4291-a343-61006c42454f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:09:01Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "bdfa6145-2f40-45ad-b947-d97efa7cbb57", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:09:01Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "ee00d4d7-9528-44a0-927b-644ecaf9d70c", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:09:01Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "6fb36286-f8f9-4184-bbe5-0487e27d4371", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:09:01Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:01Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "8eda6909-f8c9-4c10-9eb9-1ba37a43fca2", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:09:02Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:02Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:02Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "17bee899-de73-48bb-a082-a5c3479a4a9a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:09:02Z INFO Multi Node reconciled successfully. {"ResourceName": "triton-grpc-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:09:04Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:09:04Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:09:04Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "2957f957-75cd-42af-a213-35fcacb4a951", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-grpc-metrics-dashboard"} 2026-07-19T06:13:01Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:01Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:01Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3e992ffa-fb21-41de-a81e-30f62d0b52a9", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc"} 2026-07-19T06:13:05Z DEBUG Deleting ClusterRoleBinding tensorflow-standard-triton-models-bucket-sa-auth-delegator in namespace tensorflow-standard {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "85aef867-66d6-4f1f-8a50-4fefe51db59a", "error": "InferenceService.serving.kserve.io \"tensorflow-standard-grpc\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"inferenceservice.finalizers\"}"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:13:05Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc"} 2026-07-19T06:13:05Z DEBUG Deleting ClusterRoleBinding tensorflow-standard-triton-models-bucket-sa-auth-delegator in namespace tensorflow-standard {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "43504c2f-b950-4f31-91a6-c0f43dea975f", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc"} 2026-07-19T06:13:05Z DEBUG Deleting ClusterRoleBinding tensorflow-standard-triton-models-bucket-sa-auth-delegator in namespace tensorflow-standard {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "fc642efb-15f2-41cd-aa77-e35b5c04fbd8", "error": "inferenceservices.serving.kserve.io \"tensorflow-standard-grpc\" not found"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:13:05Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3d6e5335-e355-4f92-ad25-d08b8c7e502a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3d6e5335-e355-4f92-ad25-d08b8c7e502a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "3d6e5335-e355-4f92-ad25-d08b8c7e502a", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "0a5a304d-4e44-463c-b842-66c211c1b0c8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "0a5a304d-4e44-463c-b842-66c211c1b0c8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:05Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-grpc","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-grpc", "reconcileID": "0a5a304d-4e44-463c-b842-66c211c1b0c8", "InferenceService": "tensorflow-standard-grpc", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:06Z INFO Reconcile event triggered by serving runtime: triton-grpc-runtime 2026-07-19T06:13:06Z INFO No InferenceServices found for Serving Runtime: triton-grpc-runtime 2026-07-19T06:13:06Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "triton-grpc-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:06Z INFO Multi Node reconciling. {"ResourceName": "triton-grpc-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:08Z INFO Multi Node reconciled successfully. {"ResourceName": "triton-grpc-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6075c360-fbbe-4616-aa22-c9ca85aefe27", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:11Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6075c360-fbbe-4616-aa22-c9ca85aefe27", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:13:11Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6075c360-fbbe-4616-aa22-c9ca85aefe27", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace tensorflow-standard because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:13:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "18b73a33-b7be-473b-aef3-8d03c2654317", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:11Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "18b73a33-b7be-473b-aef3-8d03c2654317", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "7f457edb-bbb5-477a-ae46-30059f0bb08f", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:13:11Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "7f457edb-bbb5-477a-ae46-30059f0bb08f", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:13:11Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "35f2ca53-ce1e-4383-972e-3866e867b7d5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:11Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "35f2ca53-ce1e-4383-972e-3866e867b7d5", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "576282c1-8aba-4ccb-8f8a-22b7c7f57e04", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "49babb87-e231-484f-8786-13fee786eaaa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:13:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "49babb87-e231-484f-8786-13fee786eaaa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "a26ddc66-827d-4c29-8861-1e064df581d2", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:13:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "a26ddc66-827d-4c29-8861-1e064df581d2", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "871b15ef-b30d-4add-99e8-73eaa2ca1a22", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "bc3fda95-69f4-47af-9c5b-6d2cf12006ed", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "1387bbce-eab9-408a-a49d-0e54ed845dfa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:13:13Z INFO Reconcile event triggered by serving runtime: triton-rest-runtime 2026-07-19T06:13:13Z INFO No InferenceServices found for Serving Runtime: triton-rest-runtime 2026-07-19T06:13:13Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "triton-rest-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Multi Node reconciling. {"ResourceName": "triton-rest-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "1387bbce-eab9-408a-a49d-0e54ed845dfa", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "7695080e-84e7-48fa-b596-2a0209229462", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO inferenceservice-resource Defaulting for InferenceService {"name": "tensorflow-standard-rest", "name": "tensorflow-standard-rest"} 2026-07-19T06:13:13Z INFO inferenceservice-resource Validation for InferenceService upon creation {"namespace": "tensorflow-standard", "isvc": "tensorflow-standard-rest"} 2026-07-19T06:13:13Z INFO inferenceservice-resource Checking if namespace is protected {"namespace": "tensorflow-standard", "isvc": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "protectedNamespace": "redhat-ods-applications"} 2026-07-19T06:13:13Z INFO inferenceservice-resource Namespace is not protected {"namespace": "tensorflow-standard", "isvc": "tensorflow-standard-rest"} 2026-07-19T06:13:13Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG ServiceMonitor not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "create": "tensorflow-standard-rest-metrics"} 2026-07-19T06:13:13Z DEBUG ConfigMap not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "create": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8ddf1f0c-d794-439a-9bd1-228696fd19f7", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:13Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "65fe4178-8cd1-414e-8900-8da7cf71c384", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:13Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f350dcb2-1b4a-4a50-b4a2-2b3d047e3d26", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:13Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "f9ecd8b5-2848-4bfb-bf7c-74a9e1ac379f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:13Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:13Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:13Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "3760b93d-5cbf-4685-a428-eeeb8e83e633", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:14Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:14Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:14Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "d4e05ee0-294d-418c-bb8a-ce56475d361e", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:15Z INFO Multi Node reconciled successfully. {"ResourceName": "triton-rest-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:17Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:17Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:17Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "36b072c7-6119-4b66-8172-46b905ab9c7f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z INFO Adding Finalizer {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z INFO Reconciling InferenceService for Kserve in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Reconciling ClusterRoleBinding for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG ClusterRoleBinding not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Reconciling Generic Route for Kserve Raw InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z INFO InferenceService does not have label 'networking.kserve.io/visibility' annotation set to 'exposed'. Skipping route creation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Openshift Route not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Reconciling Metrics Service for InferenceService, checking if there are resource for deletion {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG No Prometheus annotations on ServingRuntime, skipping creation of metrics resources {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Service not found. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Reconciling Metrics ServiceMonitor for InferenceService {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Successfully fetch deployed ServiceMonitor {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG No delta found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG Successfully fetched ConfigMap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "ConfigMap:": "tensorflow-standard-rest-metrics-dashboard"} 2026-07-19T06:13:26Z DEBUG No delta found in metrics configmap {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler No Prometheus external autoscaling metric found, KEDA resources not required by this InferenceService. Ensuring InferenceService is removed from owner references. {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:26Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:26Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "a0057191-8d08-4b9a-bcff-d3b060e5acc3", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest"} 2026-07-19T06:13:37Z DEBUG Deleting ClusterRoleBinding tensorflow-standard-triton-models-bucket-sa-auth-delegator in namespace tensorflow-standard {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z ERROR Reconciler error {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "8b694c7f-170d-4a6c-8224-bf8c9479e123", "error": "InferenceService.serving.kserve.io \"tensorflow-standard-rest\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"inferenceservice.finalizers\"}"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:13:37Z INFO InferenceService being deleted {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG Deleting InferenceService in RawDeployment mode {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest"} 2026-07-19T06:13:37Z DEBUG Deleting ClusterRoleBinding tensorflow-standard-triton-models-bucket-sa-auth-delegator in namespace tensorflow-standard {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler Resource not found, skipping owner reference removal {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "kind": "&TypeMeta{Kind:,APIVersion:,}", "namespace": "tensorflow-standard", "name": "inference-prometheus-auth"} 2026-07-19T06:13:37Z DEBUG KserveKEDAReconciler hasPrometheusExternalAutoscalingMetric {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "autoscaling": null} 2026-07-19T06:13:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "439740b7-1d51-416f-9ae7-012277f1e10f", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "79217cd0-3294-4f76-bde3-864fbc3f58e1", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "79217cd0-3294-4f76-bde3-864fbc3f58e1", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "79217cd0-3294-4f76-bde3-864fbc3f58e1", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z INFO Stop InferenceService reconciliation {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "1fd10f2d-2ed9-4f9e-949d-14a43c170857", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z DEBUG Triggering RawDeployment cleanup - no active InferenceServices found {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "1fd10f2d-2ed9-4f9e-949d-14a43c170857", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:37Z INFO KserveKEDAReconciler Cleaning up KEDA resources in namespace {"controller": "inferenceservice", "controllerGroup": "serving.kserve.io", "controllerKind": "InferenceService", "InferenceService": {"name":"tensorflow-standard-rest","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "tensorflow-standard-rest", "reconcileID": "1fd10f2d-2ed9-4f9e-949d-14a43c170857", "InferenceService": "tensorflow-standard-rest", "namespace": "tensorflow-standard", "namespace": "tensorflow-standard"} 2026-07-19T06:13:38Z INFO Reconcile event triggered by serving runtime: triton-rest-runtime 2026-07-19T06:13:38Z INFO No InferenceServices found for Serving Runtime: triton-rest-runtime 2026-07-19T06:13:38Z INFO No monitoring namespace detected, skipping monitoring reconciliation. {"ResourceName": "triton-rest-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:38Z INFO Multi Node reconciling. {"ResourceName": "triton-rest-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:40Z INFO Multi Node reconciled successfully. {"ResourceName": "triton-rest-runtime", "Namespace": "tensorflow-standard"} 2026-07-19T06:13:43Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8ac588dd-b1b9-40f2-a331-d0c3a7df4d91", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:43Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8ac588dd-b1b9-40f2-a331-d0c3a7df4d91", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:13:43Z ERROR Reconciler error {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "8ac588dd-b1b9-40f2-a331-d0c3a7df4d91", "error": "configmaps \"odh-kserve-custom-ca-bundle\" is forbidden: unable to create new content in namespace tensorflow-standard because it is being terminated"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:316 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:263 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2 /cachi2/output/deps/gomod/pkg/mod/sigs.k8s.io/controller-runtime@v0.19.7/pkg/internal/controller/controller.go:224 2026-07-19T06:13:43Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "f9c2d169-7698-4945-a056-33944acf66b4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-trusted-ca-bundle", "reconcileID": "f9c2d169-7698-4945-a056-33944acf66b4", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:43Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "cbadc622-cfcd-44ef-abef-ea7db4a40648", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:13:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "openshift-service-ca.crt", "reconcileID": "cbadc622-cfcd-44ef-abef-ea7db4a40648", "ConfigMap": "openshift-service-ca.crt", "namespace": "tensorflow-standard"} 2026-07-19T06:13:43Z INFO Cert ConfigMap not found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6635eced-ef85-4e03-ac96-28d50bb001a7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:13:43Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"tensorflow-standard"}, "namespace": "tensorflow-standard", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "6635eced-ef85-4e03-ac96-28d50bb001a7", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "tensorflow-standard"} 2026-07-19T06:20:05Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"e2e-aigw-f978966b","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "e2e-aigw-f978966b", "reconcileID": "6f182a60-5178-49de-840e-d2e2b3ca937f", "Gateway": "e2e-aigw-f978966b", "namespace": "openshift-ingress"} 2026-07-19T06:20:05Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"e2e-aigw-f978966b","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "e2e-aigw-f978966b", "reconcileID": "eb0f352b-d25d-4c94-8139-83e1fbcd8a63", "Gateway": "e2e-aigw-f978966b", "namespace": "openshift-ingress"} 2026-07-19T06:20:05Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"e2e-aigw-f978966b","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "e2e-aigw-f978966b", "reconcileID": "6634bf0a-52d4-4a34-bfcc-ed31603a4098", "Gateway": "e2e-aigw-f978966b", "namespace": "openshift-ingress"} 2026-07-19T06:20:05Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"e2e-aigw-f978966b","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "e2e-aigw-f978966b", "reconcileID": "6fb99980-c99d-4ab0-a71e-d76ab6bc8a57", "Gateway": "e2e-aigw-f978966b", "namespace": "openshift-ingress"} 2026-07-19T06:20:05Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "openshift-service-ca.crt", "reconcileID": "85000902-685a-46db-a5cd-f81ce4e964d4", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenant-e2e-aigw-f978966b"} 2026-07-19T06:20:05Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "odh-trusted-ca-bundle", "reconcileID": "35cf9d64-5711-4150-93aa-406d0fd1ad70", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenant-e2e-aigw-f978966b", "create": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:20:05Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "odh-trusted-ca-bundle", "reconcileID": "35cf9d64-5711-4150-93aa-406d0fd1ad70", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenant-e2e-aigw-f978966b"} 2026-07-19T06:20:05Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "openshift-service-ca.crt", "reconcileID": "a31db3da-99e3-4f25-81ea-b09fee48af30", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenant-e2e-aigw-f978966b", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:20:05Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "openshift-service-ca.crt", "reconcileID": "a31db3da-99e3-4f25-81ea-b09fee48af30", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenant-e2e-aigw-f978966b"} 2026-07-19T06:20:05Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "cb3846ae-07f7-4658-bc01-18777bbca6b9", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ai-tenant-e2e-aigw-f978966b"} 2026-07-19T06:20:05Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "openshift-service-ca.crt", "reconcileID": "52794318-6144-4d33-9cf4-affa588652f3", "ConfigMap": "openshift-service-ca.crt", "namespace": "ai-tenant-e2e-aigw-f978966b"} 2026-07-19T06:20:05Z DEBUG Delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "odh-trusted-ca-bundle", "reconcileID": "6fcf21d0-c4df-4ab3-89a6-ec068e7d2acb", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenant-e2e-aigw-f978966b", "update": "odh-kserve-custom-ca-bundle"} 2026-07-19T06:20:05Z DEBUG Deleted the storage-config Secret to update the custom cert {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-trusted-ca-bundle","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "odh-trusted-ca-bundle", "reconcileID": "6fcf21d0-c4df-4ab3-89a6-ec068e7d2acb", "ConfigMap": "odh-trusted-ca-bundle", "namespace": "ai-tenant-e2e-aigw-f978966b"} 2026-07-19T06:20:05Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"odh-kserve-custom-ca-bundle","namespace":"ai-tenant-e2e-aigw-f978966b"}, "namespace": "ai-tenant-e2e-aigw-f978966b", "name": "odh-kserve-custom-ca-bundle", "reconcileID": "345e4c9f-4971-4fa9-a29f-647f5ee96494", "ConfigMap": "odh-kserve-custom-ca-bundle", "namespace": "ai-tenant-e2e-aigw-f978966b"} 2026-07-19T06:20:06Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"e2e-aigw-f978966b","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "e2e-aigw-f978966b", "reconcileID": "12ffec44-7e53-4d11-8733-5fad6bf3fe9c", "Gateway": "e2e-aigw-f978966b", "namespace": "openshift-ingress"} 2026-07-19T06:20:06Z DEBUG No delta found {"controller": "core-configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "ConfigMap": {"name":"openshift-service-ca.crt","namespace":"redhat-ods-applications"}, "namespace": "redhat-ods-applications", "name": "openshift-service-ca.crt", "reconcileID": "ba569d1b-dacc-4fcb-bf0b-9ae244b7519f", "ConfigMap": "openshift-service-ca.crt", "namespace": "redhat-ods-applications"} 2026-07-19T06:20:07Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"e2e-aigw-f978966b","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "e2e-aigw-f978966b", "reconcileID": "045a8129-652c-452c-afc7-2575803c691c", "Gateway": "e2e-aigw-f978966b", "namespace": "openshift-ingress"} 2026-07-19T06:20:07Z DEBUG Successfully reconciled Gateway resources {"controller": "gateway-auth-bootstrap", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "Gateway": {"name":"e2e-aigw-f978966b","namespace":"openshift-ingress"}, "namespace": "openshift-ingress", "name": "e2e-aigw-f978966b", "reconcileID": "63b91e76-e6fa-4baa-86d8-fb52da1b8f73", "Gateway": "e2e-aigw-f978966b", "namespace": "openshift-ingress"}