=== events in odh-ai-gateway-infra (2026-11-04T05:49:15Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 5m3s Normal Scheduled pod/maas-api-revoke-sub-db136c12-pk5gl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-db136c12-pk5gl to ip-10-0-130-185.us-west-2.compute.internal 2m26s Normal Scheduled pod/maas-api-revoke-sub-4decd865-zfldm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4decd865-zfldm to ip-10-0-130-185.us-west-2.compute.internal 4m15s Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb to ip-10-0-130-185.us-west-2.compute.internal 10m Normal Scheduled pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p to ip-10-0-133-143.us-west-2.compute.internal 10m Normal Scheduled pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx to ip-10-0-133-143.us-west-2.compute.internal 9m47s Normal Scheduled pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 to ip-10-0-139-34.us-west-2.compute.internal 4m15s Normal Scheduled pod/maas-api-key-cleanup-29896185-dr65m Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29896185-dr65m to ip-10-0-139-34.us-west-2.compute.internal 15m Normal Scheduled pod/maas-api-674d648f7b-sxqpl Successfully assigned odh-ai-gateway-infra/maas-api-674d648f7b-sxqpl to ip-10-0-133-143.us-west-2.compute.internal 16m Normal Scheduled pod/postgres-7cdbf6dc44-bc2r4 Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-bc2r4 to ip-10-0-139-34.us-west-2.compute.internal 4m45s Normal Scheduled pod/maas-api-revoke-sub-e69da566-4tdk4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e69da566-4tdk4 to ip-10-0-130-185.us-west-2.compute.internal 10m Normal Scheduled pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 to ip-10-0-133-143.us-west-2.compute.internal 2m47s Normal Scheduled pod/maas-api-revoke-sub-df357346-kn6w8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-df357346-kn6w8 to ip-10-0-130-185.us-west-2.compute.internal 4m15s Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj to ip-10-0-139-34.us-west-2.compute.internal 14m Normal Scheduled pod/maas-api-5cf85ff9fd-9mt9t Successfully assigned odh-ai-gateway-infra/maas-api-5cf85ff9fd-9mt9t to ip-10-0-133-143.us-west-2.compute.internal 10m Normal Scheduled pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k to ip-10-0-139-34.us-west-2.compute.internal 2m41s Normal Scheduled pod/maas-api-revoke-sub-8253ce6b-f78vw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8253ce6b-f78vw to ip-10-0-130-185.us-west-2.compute.internal 4m39s Normal Scheduled pod/maas-api-revoke-sub-6e443a86-gqh8f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6e443a86-gqh8f to ip-10-0-130-185.us-west-2.compute.internal 9m58s Normal Scheduled pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr to ip-10-0-133-143.us-west-2.compute.internal 4m55s Normal Scheduled pod/maas-api-revoke-sub-10107d08-q5zzt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-10107d08-q5zzt to ip-10-0-139-34.us-west-2.compute.internal 5m1s Normal Scheduled pod/maas-api-revoke-sub-2f464bb2-gpqlr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2f464bb2-gpqlr to ip-10-0-130-185.us-west-2.compute.internal 4m46s Normal Scheduled pod/maas-api-revoke-sub-c5ab8c96-lzr2j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c5ab8c96-lzr2j to ip-10-0-130-185.us-west-2.compute.internal 4m34s Normal Scheduled pod/maas-api-revoke-sub-57776a9b-9fwsj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-57776a9b-9fwsj to ip-10-0-130-185.us-west-2.compute.internal 3m48s Normal Scheduled pod/maas-api-revoke-sub-85bc275b-rxc8q Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85bc275b-rxc8q to ip-10-0-130-185.us-west-2.compute.internal 4m15s Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 to ip-10-0-130-185.us-west-2.compute.internal 4m59s Normal Scheduled pod/maas-api-revoke-sub-7b4ebc2d-w7xb8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7b4ebc2d-w7xb8 to ip-10-0-130-185.us-west-2.compute.internal 3m36s Normal Scheduled pod/maas-api-revoke-sub-736fd121-nxnn7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-736fd121-nxnn7 to ip-10-0-130-185.us-west-2.compute.internal 2m25s Normal Scheduled pod/maas-api-revoke-sub-7611e660-hqd2t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7611e660-hqd2t to ip-10-0-139-34.us-west-2.compute.internal 10m Normal Scheduled pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q to ip-10-0-139-34.us-west-2.compute.internal 16m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 16m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-bc2r4 16m Normal AddedInterface pod/postgres-7cdbf6dc44-bc2r4 Add eth0 [10.133.0.38/23] from ovn-kubernetes 16m Normal Pulling pod/postgres-7cdbf6dc44-bc2r4 Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 16m Normal Pulled pod/postgres-7cdbf6dc44-bc2r4 Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 7.531s (7.531s including waiting). Image size: 403732708 bytes. 16m Normal Created pod/postgres-7cdbf6dc44-bc2r4 Container created 16m Normal Started pod/postgres-7cdbf6dc44-bc2r4 Container started 15m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-674d648f7b from 0 to 1 15m Warning FailedCreate replicaset/maas-api-674d648f7b Error creating: pods "maas-api-674d648f7b-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 15m Normal Pulling pod/maas-api-674d648f7b-sxqpl Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 15m Normal SuccessfulCreate replicaset/maas-api-674d648f7b Created pod: maas-api-674d648f7b-sxqpl 15m Normal AddedInterface pod/maas-api-674d648f7b-sxqpl Add eth0 [10.132.0.34/23] from ovn-kubernetes 15m Normal Created pod/maas-api-674d648f7b-sxqpl Container created 15m Normal Started pod/maas-api-674d648f7b-sxqpl Container started 15m Normal Pulled pod/maas-api-674d648f7b-sxqpl Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 3.991s (3.991s including waiting). Image size: 194589557 bytes. 14m Normal AddedInterface pod/maas-api-5cf85ff9fd-9mt9t Add eth0 [10.132.0.35/23] from ovn-kubernetes 14m Normal SuccessfulCreate replicaset/maas-api-5cf85ff9fd Created pod: maas-api-5cf85ff9fd-9mt9t 14m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-5cf85ff9fd from 0 to 1 14m Normal Pulling pod/maas-api-5cf85ff9fd-9mt9t Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 14m Normal Started pod/maas-api-5cf85ff9fd-9mt9t Container started 14m Normal Created pod/maas-api-5cf85ff9fd-9mt9t Container created 14m Normal Pulled pod/maas-api-5cf85ff9fd-9mt9t Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 997ms (997ms including waiting). Image size: 194589557 bytes. 14m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-674d648f7b from 1 to 0 14m Normal SuccessfulDelete replicaset/maas-api-674d648f7b Deleted pod: maas-api-674d648f7b-sxqpl 14m Normal Killing pod/maas-api-674d648f7b-sxqpl Stopping container maas-api 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-a84d48-56ff9b7d89 Created pod: maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-a84d48 Scaled up replica set maas-api-e2e-worker-w3-a84d48-56ff9b7d89 from 0 to 1 10m Warning FailedMount pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w3-a84d48-serving-cert" not found 10m Normal Pulling pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 10m Normal AddedInterface pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx Add eth0 [10.132.0.50/23] from ovn-kubernetes 10m Normal Pulled pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 1.813s (1.813s including waiting). Image size: 194589557 bytes. 10m Normal Started pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx Container started 10m Normal Created pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx Container created 10m Warning FailedMount pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w4-901a00-serving-cert" not found 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-901a00-59d87b6dd8 Created pod: maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-901a00 Scaled up replica set maas-api-e2e-worker-w4-901a00-59d87b6dd8 from 0 to 1 10m Normal Pulling pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 10m Normal AddedInterface pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p Add eth0 [10.132.0.53/23] from ovn-kubernetes 10m Normal Pulled pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 1.026s (1.026s including waiting). Image size: 194589557 bytes. 10m Normal Created pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p Container created 10m Normal Started pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p Container started 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-961485 Scaled up replica set maas-api-e2e-worker-w2-961485-5d6988956d from 0 to 1 10m Warning FailedMount pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w2-961485-serving-cert" not found 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-961485-5d6988956d Created pod: maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 10m Normal AddedInterface pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 Add eth0 [10.132.0.54/23] from ovn-kubernetes 10m Normal Pulling pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 10m Normal Pulled pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 905ms (905ms including waiting). Image size: 194589557 bytes. 10m Normal Created pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 Container created 10m Normal Started pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 Container started 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-098178-64854f4957 Created pod: maas-api-e2e-worker-w1-098178-64854f4957-ttb4q 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-098178 Scaled up replica set maas-api-e2e-worker-w1-098178-64854f4957 from 0 to 1 10m Warning FailedMount pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w1-098178-serving-cert" not found 10m Normal Pulling pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 10m Normal AddedInterface pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q Add eth0 [10.133.0.51/23] from ovn-kubernetes 10m Normal Pulled pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 2.863s (2.863s including waiting). Image size: 194589557 bytes. 10m Normal Started pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q Container started 10m Normal Created pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q Container created 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-283815 Scaled up replica set maas-api-e2e-worker-w5-283815-78ff4d968f from 0 to 1 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-283815-78ff4d968f Created pod: maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k 10m Warning FailedMount pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w5-283815-serving-cert" not found 10m Normal AddedInterface pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k Add eth0 [10.133.0.52/23] from ovn-kubernetes 10m Normal Pulling pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 10m Normal Started pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k Container started 10m Normal Pulled pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 1.026s (1.026s including waiting). Image size: 194589557 bytes. 10m Normal Created pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k Container created 9m59s Warning FailedMount pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w0-90dc8d-serving-cert" not found 9m59s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-90dc8d-784cbc88cf Created pod: maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr 9m59s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-90dc8d Scaled up replica set maas-api-e2e-worker-w0-90dc8d-784cbc88cf from 0 to 1 9m58s Normal AddedInterface pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr Add eth0 [10.132.0.58/23] from ovn-kubernetes 9m58s Normal Pulling pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 9m56s Normal Pulled pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 1.093s (1.093s including waiting). Image size: 194589557 bytes. 9m56s Normal Started pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr Container started 9m56s Normal Created pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr Container created 9m48s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495 Created pod: maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 9m48s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-fbbad9 Scaled up replica set maas-api-e2e-worker-w6-fbbad9-5dd4ddf495 from 0 to 1 9m48s Warning FailedMount pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w6-fbbad9-serving-cert" not found 9m47s Normal Pulling pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 9m47s Normal AddedInterface pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 Add eth0 [10.133.0.53/23] from ovn-kubernetes 9m46s Normal Pulled pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 996ms (996ms including waiting). Image size: 194589557 bytes. 9m46s Normal Created pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 Container created 9m46s Normal Started pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 Container started 5m4s Normal SuccessfulCreate job/maas-api-revoke-sub-db136c12 Created pod: maas-api-revoke-sub-db136c12-pk5gl 5m3s Normal AddedInterface pod/maas-api-revoke-sub-db136c12-pk5gl Add eth0 [10.134.0.57/23] from ovn-kubernetes 5m3s Normal Pulling pod/maas-api-revoke-sub-db136c12-pk5gl Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 5m2s Normal SuccessfulCreate job/maas-api-revoke-sub-2f464bb2 Created pod: maas-api-revoke-sub-2f464bb2-gpqlr 5m1s Normal Pulling pod/maas-api-revoke-sub-2f464bb2-gpqlr Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 5m1s Normal AddedInterface pod/maas-api-revoke-sub-2f464bb2-gpqlr Add eth0 [10.134.0.58/23] from ovn-kubernetes 5m Normal SuccessfulCreate job/maas-api-revoke-sub-7b4ebc2d Created pod: maas-api-revoke-sub-7b4ebc2d-w7xb8 4m59s Normal AddedInterface pod/maas-api-revoke-sub-7b4ebc2d-w7xb8 Add eth0 [10.134.0.59/23] from ovn-kubernetes 4m59s Normal Pulling pod/maas-api-revoke-sub-7b4ebc2d-w7xb8 Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 4m59s Normal Pulled pod/maas-api-revoke-sub-db136c12-pk5gl Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 4.422s (4.422s including waiting). Image size: 107195206 bytes. 4m58s Normal Started pod/maas-api-revoke-sub-2f464bb2-gpqlr Container started 4m58s Normal Created pod/maas-api-revoke-sub-2f464bb2-gpqlr Container created 4m58s Normal Pulled pod/maas-api-revoke-sub-2f464bb2-gpqlr Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 3.009s (3.009s including waiting). Image size: 107195206 bytes. 4m58s Normal Started pod/maas-api-revoke-sub-db136c12-pk5gl Container started 4m58s Normal Created pod/maas-api-revoke-sub-db136c12-pk5gl Container created 4m57s Normal Started pod/maas-api-revoke-sub-7b4ebc2d-w7xb8 Container started 4m57s Normal Pulled pod/maas-api-revoke-sub-7b4ebc2d-w7xb8 Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.06s (2.06s including waiting). Image size: 107195206 bytes. 4m57s Normal Created pod/maas-api-revoke-sub-7b4ebc2d-w7xb8 Container created 4m56s Normal SuccessfulCreate job/maas-api-revoke-sub-10107d08 Created pod: maas-api-revoke-sub-10107d08-q5zzt 4m55s Normal Pulling pod/maas-api-revoke-sub-10107d08-q5zzt Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 4m55s Normal AddedInterface pod/maas-api-revoke-sub-10107d08-q5zzt Add eth0 [10.133.0.62/23] from ovn-kubernetes 4m55s Normal Completed job/maas-api-revoke-sub-db136c12 Job completed 4m54s Normal Completed job/maas-api-revoke-sub-2f464bb2 Job completed 4m53s Normal Completed job/maas-api-revoke-sub-7b4ebc2d Job completed 4m48s Normal Pulled pod/maas-api-revoke-sub-10107d08-q5zzt Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 7.736s (7.736s including waiting). Image size: 107195206 bytes. 4m47s Normal SuccessfulCreate job/maas-api-revoke-sub-c5ab8c96 Created pod: maas-api-revoke-sub-c5ab8c96-lzr2j 4m47s Normal Started pod/maas-api-revoke-sub-10107d08-q5zzt Container started 4m47s Normal Created pod/maas-api-revoke-sub-10107d08-q5zzt Container created 4m46s Normal Started pod/maas-api-revoke-sub-c5ab8c96-lzr2j Container started 4m46s Normal Pulled pod/maas-api-revoke-sub-c5ab8c96-lzr2j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m46s Normal AddedInterface pod/maas-api-revoke-sub-c5ab8c96-lzr2j Add eth0 [10.134.0.60/23] from ovn-kubernetes 4m46s Normal Created pod/maas-api-revoke-sub-c5ab8c96-lzr2j Container created 4m45s Normal SuccessfulCreate job/maas-api-revoke-sub-e69da566 Created pod: maas-api-revoke-sub-e69da566-4tdk4 4m45s Normal AddedInterface pod/maas-api-revoke-sub-e69da566-4tdk4 Add eth0 [10.134.0.61/23] from ovn-kubernetes 4m45s Normal Pulled pod/maas-api-revoke-sub-e69da566-4tdk4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m44s Normal Started pod/maas-api-revoke-sub-e69da566-4tdk4 Container started 4m44s Normal Created pod/maas-api-revoke-sub-e69da566-4tdk4 Container created 4m44s Normal Completed job/maas-api-revoke-sub-10107d08 Job completed 4m42s Normal Completed job/maas-api-revoke-sub-c5ab8c96 Job completed 4m41s Normal Completed job/maas-api-revoke-sub-e69da566 Job completed 4m39s Normal SuccessfulCreate job/maas-api-revoke-sub-6e443a86 Created pod: maas-api-revoke-sub-6e443a86-gqh8f 4m38s Normal Created pod/maas-api-revoke-sub-6e443a86-gqh8f Container created 4m38s Normal Pulled pod/maas-api-revoke-sub-6e443a86-gqh8f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m38s Normal AddedInterface pod/maas-api-revoke-sub-6e443a86-gqh8f Add eth0 [10.134.0.62/23] from ovn-kubernetes 4m38s Normal Started pod/maas-api-revoke-sub-6e443a86-gqh8f Container started 4m35s Normal SuccessfulCreate job/maas-api-revoke-sub-57776a9b Created pod: maas-api-revoke-sub-57776a9b-9fwsj 4m35s Normal Completed job/maas-api-revoke-sub-6e443a86 Job completed 4m35s Normal AddedInterface pod/maas-api-revoke-sub-57776a9b-9fwsj Add eth0 [10.134.0.63/23] from ovn-kubernetes 4m34s Normal Pulled pod/maas-api-revoke-sub-57776a9b-9fwsj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m34s Normal Started pod/maas-api-revoke-sub-57776a9b-9fwsj Container started 4m34s Normal Created pod/maas-api-revoke-sub-57776a9b-9fwsj Container created 4m31s Normal Completed job/maas-api-revoke-sub-57776a9b Job completed 4m26s Normal Killing pod/maas-api-e2e-worker-w1-098178-64854f4957-ttb4q Stopping container maas-api 4m25s Normal Killing pod/maas-api-e2e-worker-w5-283815-78ff4d968f-g2c9k Stopping container maas-api 4m24s Normal Killing pod/maas-api-e2e-worker-w0-90dc8d-784cbc88cf-s8rzr Stopping container maas-api 4m17s Normal Killing pod/maas-api-e2e-worker-w6-fbbad9-5dd4ddf495-jn4s6 Stopping container maas-api 4m15s Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29896185 4m15s Normal AddedInterface pod/maas-api-key-cleanup-29896185-dr65m Add eth0 [10.133.0.66/23] from ovn-kubernetes 4m15s Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 Add eth0 [10.134.0.65/23] from ovn-kubernetes 4m15s Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-961485-29896185 Created pod: maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj 4m15s Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-901a00 Created job maas-api-key-cleanup-e2e-worker-w4-901a00-29896185 4m15s Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185 Created pod: maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb 4m15s Normal SuccessfulCreate job/maas-api-key-cleanup-29896185 Created pod: maas-api-key-cleanup-29896185-dr65m 4m15s Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185 Created pod: maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 4m15s Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj Add eth0 [10.133.0.65/23] from ovn-kubernetes 4m15s Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-a84d48 Created job maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185 4m15s Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-961485 Created job maas-api-key-cleanup-e2e-worker-w2-961485-29896185 4m15s Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb Add eth0 [10.134.0.66/23] from ovn-kubernetes 4m Normal Pulled pod/maas-api-key-cleanup-29896185-dr65m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m Normal Created pod/maas-api-key-cleanup-29896185-dr65m Container created 4m Normal Started pod/maas-api-key-cleanup-29896185-dr65m Container started 4m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj Container created 4m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj Container started 3m59s Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 Container created 3m59s Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 Container started 3m59s Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m59s Warning BackOff pod/maas-api-key-cleanup-29896185-dr65m Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29896185-dr65m_odh-ai-gateway-infra(f35d787d-88f2-4e1c-871f-6e2c138aef36) 3m59s Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj_odh-ai-gateway-infra(730e245d-87b5-4165-92e9-a4c8cc578234) 3m58s Normal SuccessfulDelete job/maas-api-key-cleanup-29896185 Deleted pod: maas-api-key-cleanup-29896185-dr65m 3m58s Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4_odh-ai-gateway-infra(dbdb0216-c592-4801-a52a-41c51ba709b6) 3m58s Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-961485-29896185 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-961485-29896185-qjzxj 3m57s Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29896185, condition: Failed 3m57s Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb Container started 3m57s Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185-5r4x4 3m57s Warning BackoffLimitExceeded job/maas-api-key-cleanup-29896185 Job has reached the specified backoff limit 3m57s Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-961485-29896185 Job has reached the specified backoff limit 3m57s Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb Container created 3m57s Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m57s Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-961485 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-961485-29896185, condition: Failed 3m56s Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb_odh-ai-gateway-infra(5a258f0e-0620-4944-bebd-3802097df915) 3m55s Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-901a00-29896185-2hpdb 3m55s Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-a84d48 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185, condition: Failed 3m55s Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-a84d48-29896185 Job has reached the specified backoff limit 3m53s Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-901a00-29896185 Job has reached the specified backoff limit 3m53s Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-901a00 Saw completed job: maas-api-key-cleanup-e2e-worker-w4-901a00-29896185, condition: Failed 3m49s Normal SuccessfulCreate job/maas-api-revoke-sub-85bc275b Created pod: maas-api-revoke-sub-85bc275b-rxc8q 3m48s Normal Started pod/maas-api-revoke-sub-85bc275b-rxc8q Container started 3m48s Normal Created pod/maas-api-revoke-sub-85bc275b-rxc8q Container created 3m48s Normal Pulled pod/maas-api-revoke-sub-85bc275b-rxc8q Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m48s Normal AddedInterface pod/maas-api-revoke-sub-85bc275b-rxc8q Add eth0 [10.134.0.68/23] from ovn-kubernetes 3m44s Normal Completed job/maas-api-revoke-sub-85bc275b Job completed 3m37s Normal SuccessfulCreate job/maas-api-revoke-sub-736fd121 Created pod: maas-api-revoke-sub-736fd121-nxnn7 3m37s Normal AddedInterface pod/maas-api-revoke-sub-736fd121-nxnn7 Add eth0 [10.134.0.70/23] from ovn-kubernetes 3m36s Normal Pulled pod/maas-api-revoke-sub-736fd121-nxnn7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m36s Normal Started pod/maas-api-revoke-sub-736fd121-nxnn7 Container started 3m36s Normal Created pod/maas-api-revoke-sub-736fd121-nxnn7 Container created 3m33s Normal Completed job/maas-api-revoke-sub-736fd121 Job completed 3m11s Normal Killing pod/maas-api-e2e-worker-w3-a84d48-56ff9b7d89-flxhx Stopping container maas-api 2m47s Normal SuccessfulCreate job/maas-api-revoke-sub-df357346 Created pod: maas-api-revoke-sub-df357346-kn6w8 2m46s Normal Created pod/maas-api-revoke-sub-df357346-kn6w8 Container created 2m46s Normal AddedInterface pod/maas-api-revoke-sub-df357346-kn6w8 Add eth0 [10.134.0.74/23] from ovn-kubernetes 2m46s Normal Pulled pod/maas-api-revoke-sub-df357346-kn6w8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m46s Normal Started pod/maas-api-revoke-sub-df357346-kn6w8 Container started 2m43s Normal Completed job/maas-api-revoke-sub-df357346 Job completed 2m41s Normal SuccessfulCreate job/maas-api-revoke-sub-8253ce6b Created pod: maas-api-revoke-sub-8253ce6b-f78vw 2m40s Normal AddedInterface pod/maas-api-revoke-sub-8253ce6b-f78vw Add eth0 [10.134.0.75/23] from ovn-kubernetes 2m40s Normal Pulled pod/maas-api-revoke-sub-8253ce6b-f78vw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m40s Normal Created pod/maas-api-revoke-sub-8253ce6b-f78vw Container created 2m40s Normal Started pod/maas-api-revoke-sub-8253ce6b-f78vw Container started 2m37s Normal Completed job/maas-api-revoke-sub-8253ce6b Job completed 2m26s Normal AddedInterface pod/maas-api-revoke-sub-4decd865-zfldm Add eth0 [10.134.0.77/23] from ovn-kubernetes 2m26s Normal SuccessfulCreate job/maas-api-revoke-sub-4decd865 Created pod: maas-api-revoke-sub-4decd865-zfldm 2m26s Normal Pulled pod/maas-api-revoke-sub-4decd865-zfldm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m25s Normal SuccessfulCreate job/maas-api-revoke-sub-7611e660 Created pod: maas-api-revoke-sub-7611e660-hqd2t 2m25s Normal Created pod/maas-api-revoke-sub-4decd865-zfldm Container created 2m25s Normal Pulled pod/maas-api-revoke-sub-7611e660-hqd2t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m25s Normal AddedInterface pod/maas-api-revoke-sub-7611e660-hqd2t Add eth0 [10.133.0.68/23] from ovn-kubernetes 2m25s Normal Started pod/maas-api-revoke-sub-4decd865-zfldm Container started 2m24s Normal Created pod/maas-api-revoke-sub-7611e660-hqd2t Container created 2m24s Normal Started pod/maas-api-revoke-sub-7611e660-hqd2t Container started 2m22s Normal Completed job/maas-api-revoke-sub-4decd865 Job completed 2m21s Normal Completed job/maas-api-revoke-sub-7611e660 Job completed 2m11s Normal Killing pod/maas-api-e2e-worker-w2-961485-5d6988956d-crlb2 Stopping container maas-api 2m9s Normal Killing pod/maas-api-e2e-worker-w4-901a00-59d87b6dd8-5wm6p Stopping container maas-api