2026-10-06T13:08:49+00:00: copying the token to /tmp/var/run/secrets/dex/serviceaccount/token rm: cannot remove '/tmp/var/run/secrets/dex/serviceaccount/token': No such file or directory 2026-10-06T13:08:50+00:00: run Dex in background with pid 19 2026-10-06T13:08:50+00:00: waiting for the token to be refreshed time=2026-10-06T13:08:50.624Z level=INFO msg="Version info" dex_version=DEV go.version="go1.26.7 (Red Hat 1.26.7-2.el10_2)" go.os=linux go.arch=amd64 time=2026-10-06T13:08:50.624Z level=INFO msg="config issuer" issuer=https://localhost:9443/idp/ time=2026-10-06T13:08:50.624Z level=INFO msg="kubernetes client" api_version=dex.coreos.com/v1 time=2026-10-06T13:08:50.629Z level=INFO msg="creating custom Kubernetes resources" time=2026-10-06T13:08:50.629Z level=INFO msg="checking if custom resource has already been created..." object=authcodes.dex.coreos.com time=2026-10-06T13:08:50.630Z level=INFO msg="custom resource not found" object=authcodes.dex.coreos.com err="not found" time=2026-10-06T13:08:50.630Z level=INFO msg="checking if custom resource has already been created..." object=authrequests.dex.coreos.com time=2026-10-06T13:08:50.630Z level=INFO msg="custom resource not found" object=authrequests.dex.coreos.com err="not found" time=2026-10-06T13:08:50.630Z level=INFO msg="checking if custom resource has already been created..." object=oauth2clients.dex.coreos.com time=2026-10-06T13:08:50.631Z level=INFO msg="custom resource not found" object=oauth2clients.dex.coreos.com err="not found" time=2026-10-06T13:08:50.631Z level=INFO msg="checking if custom resource has already been created..." object=signingkeies.dex.coreos.com time=2026-10-06T13:08:50.631Z level=INFO msg="custom resource not found" object=signingkeies.dex.coreos.com err="not found" time=2026-10-06T13:08:50.631Z level=INFO msg="checking if custom resource has already been created..." object=refreshtokens.dex.coreos.com time=2026-10-06T13:08:50.632Z level=INFO msg="custom resource not found" object=refreshtokens.dex.coreos.com err="not found" time=2026-10-06T13:08:50.632Z level=INFO msg="checking if custom resource has already been created..." object=passwords.dex.coreos.com time=2026-10-06T13:08:50.632Z level=INFO msg="custom resource not found" object=passwords.dex.coreos.com err="not found" time=2026-10-06T13:08:50.632Z level=INFO msg="checking if custom resource has already been created..." object=offlinesessionses.dex.coreos.com time=2026-10-06T13:08:50.633Z level=INFO msg="custom resource not found" object=offlinesessionses.dex.coreos.com err="not found" time=2026-10-06T13:08:50.633Z level=INFO msg="checking if custom resource has already been created..." object=connectors.dex.coreos.com time=2026-10-06T13:08:50.633Z level=INFO msg="custom resource not found" object=connectors.dex.coreos.com err="not found" time=2026-10-06T13:08:50.633Z level=INFO msg="checking if custom resource has already been created..." object=devicerequests.dex.coreos.com time=2026-10-06T13:08:50.725Z level=INFO msg="custom resource not found" object=devicerequests.dex.coreos.com err="not found" time=2026-10-06T13:08:50.725Z level=INFO msg="checking if custom resource has already been created..." object=devicetokens.dex.coreos.com time=2026-10-06T13:08:50.725Z level=INFO msg="custom resource not found" object=devicetokens.dex.coreos.com err="not found" time=2026-10-06T13:08:50.725Z level=INFO msg="found missing CRDs" count=10 time=2026-10-06T13:08:50.725Z level=INFO msg="crdHandling is 'ensure', attempting to create missing CRDs" time=2026-10-06T13:08:50.746Z level=INFO msg="successfully created custom resource" object=authcodes.dex.coreos.com time=2026-10-06T13:08:50.767Z level=INFO msg="successfully created custom resource" object=authrequests.dex.coreos.com time=2026-10-06T13:08:50.863Z level=INFO msg="successfully created custom resource" object=oauth2clients.dex.coreos.com time=2026-10-06T13:08:50.893Z level=INFO msg="successfully created custom resource" object=signingkeies.dex.coreos.com time=2026-10-06T13:08:50.930Z level=INFO msg="successfully created custom resource" object=refreshtokens.dex.coreos.com time=2026-10-06T13:08:51.023Z level=INFO msg="successfully created custom resource" object=passwords.dex.coreos.com time=2026-10-06T13:08:51.045Z level=INFO msg="successfully created custom resource" object=offlinesessionses.dex.coreos.com time=2026-10-06T13:08:51.082Z level=INFO msg="successfully created custom resource" object=connectors.dex.coreos.com time=2026-10-06T13:08:51.121Z level=INFO msg="successfully created custom resource" object=devicerequests.dex.coreos.com time=2026-10-06T13:08:51.196Z level=INFO msg="successfully created custom resource" object=devicetokens.dex.coreos.com time=2026-10-06T13:08:51.196Z level=INFO msg="config storage" storage_type=kubernetes time=2026-10-06T13:08:51.196Z level=INFO msg="config static client" client_name=oauth2-proxy time=2026-10-06T13:08:51.196Z level=INFO msg="config static client" client_name=CLI time=2026-10-06T13:08:51.196Z level=INFO msg="config connector: local passwords enabled" time=2026-10-06T13:08:51.196Z level=INFO msg="config skipping approval screen" time=2026-10-06T13:08:51.196Z level=INFO msg="continue on connector failure feature flag enabled" time=2026-10-06T13:08:51.196Z level=INFO msg="signer configured" type=local keys_rotation_period=6h time=2026-10-06T13:08:51.197Z level=INFO msg="config refresh tokens rotation" enabled=true time=2026-10-06T13:08:51.362Z level=ERROR msg="failed to get signing algorithm" err="failed to get keys: not found" time=2026-10-06T13:08:51.364Z level=INFO msg="keys expired, rotating" time=2026-10-06T13:09:01.838Z level=INFO msg="keys rotated" next_rotation=2026-10-06T19:09:01.830Z time=2026-10-06T13:09:01.838Z level=INFO msg="listening on" server=telemetry address=0.0.0.0:5558 time=2026-10-06T13:09:01.839Z level=INFO msg="listening on" server=https address=0.0.0.0:9443 2026-10-06T13:16:43+00:00: sleeping 0 seconds to prevent all replicas to restart at the same time 2026-10-06T13:16:43+00:00: token refreshed, halting Dex via SIGTERM run groups: received signal terminated 2026-10-06T13:16:43+00:00: waiting for Dex to gracefully stop 2026-10-06T13:16:44+00:00: copying the token to /tmp/var/run/secrets/dex/serviceaccount/token 2026-10-06T13:16:44+00:00: run Dex in background with pid 280 2026-10-06T13:16:44+00:00: waiting for the token to be refreshed time=2026-10-06T13:16:44.820Z level=INFO msg="Version info" dex_version=DEV go.version="go1.26.7 (Red Hat 1.26.7-2.el10_2)" go.os=linux go.arch=amd64 time=2026-10-06T13:16:44.820Z level=INFO msg="config issuer" issuer=https://localhost:9443/idp/ time=2026-10-06T13:16:44.821Z level=INFO msg="kubernetes client" api_version=dex.coreos.com/v1 time=2026-10-06T13:16:45.018Z level=INFO msg="creating custom Kubernetes resources" time=2026-10-06T13:16:45.018Z level=INFO msg="checking if custom resource has already been created..." object=authcodes.dex.coreos.com time=2026-10-06T13:16:45.020Z level=INFO msg="the custom resource already available, skipping create" object=authcodes.dex.coreos.com time=2026-10-06T13:16:45.020Z level=INFO msg="checking if custom resource has already been created..." object=authrequests.dex.coreos.com time=2026-10-06T13:16:45.021Z level=INFO msg="the custom resource already available, skipping create" object=authrequests.dex.coreos.com time=2026-10-06T13:16:45.021Z level=INFO msg="checking if custom resource has already been created..." object=oauth2clients.dex.coreos.com time=2026-10-06T13:16:45.023Z level=INFO msg="the custom resource already available, skipping create" object=oauth2clients.dex.coreos.com time=2026-10-06T13:16:45.023Z level=INFO msg="checking if custom resource has already been created..." object=signingkeies.dex.coreos.com time=2026-10-06T13:16:45.024Z level=INFO msg="the custom resource already available, skipping create" object=signingkeies.dex.coreos.com time=2026-10-06T13:16:45.024Z level=INFO msg="checking if custom resource has already been created..." object=refreshtokens.dex.coreos.com time=2026-10-06T13:16:45.026Z level=INFO msg="the custom resource already available, skipping create" object=refreshtokens.dex.coreos.com time=2026-10-06T13:16:45.026Z level=INFO msg="checking if custom resource has already been created..." object=passwords.dex.coreos.com time=2026-10-06T13:16:45.027Z level=INFO msg="the custom resource already available, skipping create" object=passwords.dex.coreos.com time=2026-10-06T13:16:45.027Z level=INFO msg="checking if custom resource has already been created..." object=offlinesessionses.dex.coreos.com time=2026-10-06T13:16:45.029Z level=INFO msg="the custom resource already available, skipping create" object=offlinesessionses.dex.coreos.com time=2026-10-06T13:16:45.029Z level=INFO msg="checking if custom resource has already been created..." object=connectors.dex.coreos.com time=2026-10-06T13:16:45.030Z level=INFO msg="the custom resource already available, skipping create" object=connectors.dex.coreos.com time=2026-10-06T13:16:45.030Z level=INFO msg="checking if custom resource has already been created..." object=devicerequests.dex.coreos.com time=2026-10-06T13:16:45.031Z level=INFO msg="the custom resource already available, skipping create" object=devicerequests.dex.coreos.com time=2026-10-06T13:16:45.031Z level=INFO msg="checking if custom resource has already been created..." object=devicetokens.dex.coreos.com time=2026-10-06T13:16:45.033Z level=INFO msg="the custom resource already available, skipping create" object=devicetokens.dex.coreos.com time=2026-10-06T13:16:45.033Z level=INFO msg="config storage" storage_type=kubernetes time=2026-10-06T13:16:45.033Z level=INFO msg="config static client" client_name=oauth2-proxy time=2026-10-06T13:16:45.033Z level=INFO msg="config static client" client_name=CLI time=2026-10-06T13:16:45.033Z level=INFO msg="config connector: local passwords enabled" time=2026-10-06T13:16:45.033Z level=INFO msg="config skipping approval screen" time=2026-10-06T13:16:45.033Z level=INFO msg="continue on connector failure feature flag enabled" time=2026-10-06T13:16:45.033Z level=INFO msg="signer configured" type=local keys_rotation_period=6h time=2026-10-06T13:16:45.033Z level=INFO msg="config refresh tokens rotation" enabled=true time=2026-10-06T13:16:45.119Z level=INFO msg="listening on" server=telemetry address=0.0.0.0:5558 time=2026-10-06T13:16:45.119Z level=INFO msg="listening on" server=https address=0.0.0.0:9443 time=2026-10-06T13:20:58.325Z level=ERROR msg="failed to rotate keys" err="get keys: GET https://10.96.0.1:443/apis/dex.coreos.com/v1/namespaces/konflux-ui/signingkeies/openid-connect-keys Internal Server Error: response from server \"{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: request timed out\",\"code\":500}\"" time=2026-10-06T13:21:45.141Z level=INFO msg="garbage collection run, delete auth" requests=3 auth_codes=0 device_requests=0 device_tokens=0 2026-10-06T13:25:17+00:00: sleeping 1 seconds to prevent all replicas to restart at the same time 2026-10-06T13:25:18+00:00: token refreshed, halting Dex via SIGTERM run groups: received signal terminated 2026-10-06T13:25:18+00:00: waiting for Dex to gracefully stop 2026-10-06T13:25:18+00:00: copying the token to /tmp/var/run/secrets/dex/serviceaccount/token 2026-10-06T13:25:19+00:00: run Dex in background with pid 561 2026-10-06T13:25:19+00:00: waiting for the token to be refreshed time=2026-10-06T13:25:19.526Z level=INFO msg="Version info" dex_version=DEV go.version="go1.26.7 (Red Hat 1.26.7-2.el10_2)" go.os=linux go.arch=amd64 time=2026-10-06T13:25:19.526Z level=INFO msg="config issuer" issuer=https://localhost:9443/idp/ time=2026-10-06T13:25:19.527Z level=INFO msg="kubernetes client" api_version=dex.coreos.com/v1 time=2026-10-06T13:25:19.624Z level=INFO msg="creating custom Kubernetes resources" time=2026-10-06T13:25:19.624Z level=INFO msg="checking if custom resource has already been created..." object=authcodes.dex.coreos.com time=2026-10-06T13:25:19.626Z level=INFO msg="the custom resource already available, skipping create" object=authcodes.dex.coreos.com time=2026-10-06T13:25:19.626Z level=INFO msg="checking if custom resource has already been created..." object=authrequests.dex.coreos.com time=2026-10-06T13:25:19.628Z level=INFO msg="the custom resource already available, skipping create" object=authrequests.dex.coreos.com time=2026-10-06T13:25:19.628Z level=INFO msg="checking if custom resource has already been created..." object=oauth2clients.dex.coreos.com time=2026-10-06T13:25:19.629Z level=INFO msg="the custom resource already available, skipping create" object=oauth2clients.dex.coreos.com time=2026-10-06T13:25:19.629Z level=INFO msg="checking if custom resource has already been created..." object=signingkeies.dex.coreos.com time=2026-10-06T13:25:19.630Z level=INFO msg="the custom resource already available, skipping create" object=signingkeies.dex.coreos.com time=2026-10-06T13:25:19.630Z level=INFO msg="checking if custom resource has already been created..." object=refreshtokens.dex.coreos.com time=2026-10-06T13:25:19.631Z level=INFO msg="the custom resource already available, skipping create" object=refreshtokens.dex.coreos.com time=2026-10-06T13:25:19.631Z level=INFO msg="checking if custom resource has already been created..." object=passwords.dex.coreos.com time=2026-10-06T13:25:19.632Z level=INFO msg="the custom resource already available, skipping create" object=passwords.dex.coreos.com time=2026-10-06T13:25:19.632Z level=INFO msg="checking if custom resource has already been created..." object=offlinesessionses.dex.coreos.com time=2026-10-06T13:25:19.633Z level=INFO msg="the custom resource already available, skipping create" object=offlinesessionses.dex.coreos.com time=2026-10-06T13:25:19.633Z level=INFO msg="checking if custom resource has already been created..." object=connectors.dex.coreos.com time=2026-10-06T13:25:19.634Z level=INFO msg="the custom resource already available, skipping create" object=connectors.dex.coreos.com time=2026-10-06T13:25:19.634Z level=INFO msg="checking if custom resource has already been created..." object=devicerequests.dex.coreos.com time=2026-10-06T13:25:19.636Z level=INFO msg="the custom resource already available, skipping create" object=devicerequests.dex.coreos.com time=2026-10-06T13:25:19.636Z level=INFO msg="checking if custom resource has already been created..." object=devicetokens.dex.coreos.com time=2026-10-06T13:25:19.637Z level=INFO msg="the custom resource already available, skipping create" object=devicetokens.dex.coreos.com time=2026-10-06T13:25:19.637Z level=INFO msg="config storage" storage_type=kubernetes time=2026-10-06T13:25:19.637Z level=INFO msg="config static client" client_name=oauth2-proxy time=2026-10-06T13:25:19.637Z level=INFO msg="config static client" client_name=CLI time=2026-10-06T13:25:19.637Z level=INFO msg="config connector: local passwords enabled" time=2026-10-06T13:25:19.637Z level=INFO msg="config skipping approval screen" time=2026-10-06T13:25:19.637Z level=INFO msg="continue on connector failure feature flag enabled" time=2026-10-06T13:25:19.637Z level=INFO msg="signer configured" type=local keys_rotation_period=6h time=2026-10-06T13:25:19.637Z level=INFO msg="config refresh tokens rotation" enabled=true time=2026-10-06T13:25:19.642Z level=INFO msg="listening on" server=telemetry address=0.0.0.0:5558 time=2026-10-06T13:25:19.642Z level=INFO msg="listening on" server=https address=0.0.0.0:9443 time=2026-10-06T13:27:56.750Z level=ERROR msg="failed to rotate keys" err="get keys: GET https://10.96.0.1:443/apis/dex.coreos.com/v1/namespaces/konflux-ui/signingkeies/openid-connect-keys Internal Server Error: response from server \"{\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"etcdserver: request timed out\",\"code\":500}\""