=== events in odh-ai-gateway-infra (2026-11-04T02:26:28Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 4m58s Normal Scheduled pod/maas-api-revoke-sub-9709d391-k8q6f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9709d391-k8q6f to ip-10-0-135-225.us-west-1.compute.internal 3m7s Normal Scheduled pod/maas-api-revoke-sub-be96d50e-bjh2b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-be96d50e-bjh2b to ip-10-0-138-45.us-west-1.compute.internal 13m Normal Scheduled pod/maas-api-55445df7f8-pvcfj Successfully assigned odh-ai-gateway-infra/maas-api-55445df7f8-pvcfj to ip-10-0-136-63.us-west-1.compute.internal 9m34s Normal Scheduled pod/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 to ip-10-0-138-45.us-west-1.compute.internal 2m22s Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w6-9adedd-lvckt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-9adedd-lvckt to ip-10-0-138-45.us-west-1.compute.internal 4m42s Normal Scheduled pod/maas-api-revoke-sub-d7960fb7-ffl6g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d7960fb7-ffl6g to ip-10-0-135-225.us-west-1.compute.internal 3m21s Normal Scheduled pod/maas-api-revoke-sub-d5ae9488-6fg4m Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d5ae9488-6fg4m to ip-10-0-138-45.us-west-1.compute.internal 14m Normal Scheduled pod/maas-api-674d648f7b-488f4 Successfully assigned odh-ai-gateway-infra/maas-api-674d648f7b-488f4 to ip-10-0-138-45.us-west-1.compute.internal 9m39s Normal Scheduled pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 to ip-10-0-136-63.us-west-1.compute.internal 4m46s Normal Scheduled pod/maas-api-revoke-sub-22fc67ff-nn5cf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-22fc67ff-nn5cf to ip-10-0-135-225.us-west-1.compute.internal 2m45s Normal Scheduled pod/maas-api-revoke-sub-e24ba4ae-k44tw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e24ba4ae-k44tw to ip-10-0-138-45.us-west-1.compute.internal 10m Normal Scheduled pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv to ip-10-0-136-63.us-west-1.compute.internal 4m39s Normal Scheduled pod/maas-api-revoke-sub-a2c552b1-b5tmg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a2c552b1-b5tmg to ip-10-0-135-225.us-west-1.compute.internal 2m53s Normal Scheduled pod/maas-api-revoke-sub-c70a9c61-wnj2l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c70a9c61-wnj2l to ip-10-0-138-45.us-west-1.compute.internal 4m36s Normal Scheduled pod/maas-api-revoke-sub-93bc7083-n998c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-93bc7083-n998c to ip-10-0-135-225.us-west-1.compute.internal 3m4s Normal Scheduled pod/maas-api-revoke-sub-740b5291-zrc6q Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-740b5291-zrc6q to ip-10-0-135-225.us-west-1.compute.internal 3m37s Normal Scheduled pod/maas-api-revoke-sub-b545d79e-mtxjd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b545d79e-mtxjd to ip-10-0-138-45.us-west-1.compute.internal 10m Normal Scheduled pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn to ip-10-0-136-63.us-west-1.compute.internal 9m59s Normal Scheduled pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs to ip-10-0-136-63.us-west-1.compute.internal 9m49s Normal Scheduled pod/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 to ip-10-0-138-45.us-west-1.compute.internal 2m34s Normal Scheduled pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg to ip-10-0-136-63.us-west-1.compute.internal 15m Normal Scheduled pod/postgres-7cdbf6dc44-4ctr9 Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-4ctr9 to ip-10-0-135-225.us-west-1.compute.internal 4m55s Normal Scheduled pod/maas-api-revoke-sub-69360ac7-s5xt6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-69360ac7-s5xt6 to ip-10-0-135-225.us-west-1.compute.internal 4m57s Normal Scheduled pod/maas-api-revoke-sub-019d8c20-8xq78 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-019d8c20-8xq78 to ip-10-0-138-45.us-west-1.compute.internal 11m Normal Scheduled pod/maas-api-key-cleanup-29895975-j59wz Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29895975-j59wz to ip-10-0-138-45.us-west-1.compute.internal 5m3s Normal Scheduled pod/maas-api-revoke-sub-2280dcfc-hrqc4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2280dcfc-hrqc4 to ip-10-0-135-225.us-west-1.compute.internal 9m54s Normal Scheduled pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh to ip-10-0-136-63.us-west-1.compute.internal 15m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 15m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-4ctr9 15m Normal AddedInterface pod/postgres-7cdbf6dc44-4ctr9 Add eth0 [10.134.0.20/23] from ovn-kubernetes 15m Normal Pulling pod/postgres-7cdbf6dc44-4ctr9 Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 15m Normal Started pod/postgres-7cdbf6dc44-4ctr9 Container started 15m Normal Created pod/postgres-7cdbf6dc44-4ctr9 Container created 15m Normal Pulled pod/postgres-7cdbf6dc44-4ctr9 Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 8.967s (8.967s including waiting). Image size: 403732708 bytes. 14m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-674d648f7b from 0 to 1 14m Warning FailedCreate replicaset/maas-api-674d648f7b Error creating: pods "maas-api-674d648f7b-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 14m Normal AddedInterface pod/maas-api-674d648f7b-488f4 Add eth0 [10.133.0.40/23] from ovn-kubernetes 14m Normal SuccessfulCreate replicaset/maas-api-674d648f7b Created pod: maas-api-674d648f7b-488f4 14m Normal Pulling pod/maas-api-674d648f7b-488f4 Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 14m Normal Started pod/maas-api-674d648f7b-488f4 Container started 14m Normal Created pod/maas-api-674d648f7b-488f4 Container created 14m Normal Pulled pod/maas-api-674d648f7b-488f4 Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 5.508s (5.508s including waiting). Image size: 194589557 bytes. 13m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-55445df7f8 from 0 to 1 13m Normal SuccessfulCreate replicaset/maas-api-55445df7f8 Created pod: maas-api-55445df7f8-pvcfj 13m Normal AddedInterface pod/maas-api-55445df7f8-pvcfj Add eth0 [10.132.0.46/23] from ovn-kubernetes 13m Normal Pulling pod/maas-api-55445df7f8-pvcfj Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 13m Normal Started pod/maas-api-55445df7f8-pvcfj Container started 13m Normal Created pod/maas-api-55445df7f8-pvcfj Container created 13m Normal Pulled pod/maas-api-55445df7f8-pvcfj Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 2.301s (2.301s including waiting). Image size: 194589557 bytes. 13m Normal Killing pod/maas-api-674d648f7b-488f4 Stopping container maas-api 13m Normal SuccessfulDelete replicaset/maas-api-674d648f7b Deleted pod: maas-api-674d648f7b-488f4 13m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-674d648f7b from 1 to 0 11m Normal SuccessfulCreate job/maas-api-key-cleanup-29895975 Created pod: maas-api-key-cleanup-29895975-j59wz 11m Normal AddedInterface pod/maas-api-key-cleanup-29895975-j59wz Add eth0 [10.133.0.48/23] from ovn-kubernetes 11m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29895975 11m Normal Pulling pod/maas-api-key-cleanup-29895975-j59wz Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 11m Normal Pulled pod/maas-api-key-cleanup-29895975-j59wz Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 4.98s (4.98s including waiting). Image size: 107195206 bytes. 11m Normal Created pod/maas-api-key-cleanup-29895975-j59wz Container created 11m Normal Pulled pod/maas-api-key-cleanup-29895975-j59wz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal Started pod/maas-api-key-cleanup-29895975-j59wz Container started 11m Warning BackOff pod/maas-api-key-cleanup-29895975-j59wz Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29895975-j59wz_odh-ai-gateway-infra(a002813d-b48a-458c-b63c-09dbe62d13d1) 11m Normal SuccessfulDelete job/maas-api-key-cleanup-29895975 Deleted pod: maas-api-key-cleanup-29895975-j59wz 11m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29895975 Job has reached the specified backoff limit 11m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29895975, condition: Failed 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-e34b54 Scaled up replica set maas-api-e2e-worker-w0-e34b54-7cd5778bcb from 0 to 1 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-e34b54-7cd5778bcb Created pod: maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn 10m Warning FailedMount pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w0-e34b54-serving-cert" not found 10m Normal Pulling pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 10m Normal AddedInterface pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn Add eth0 [10.132.0.59/23] from ovn-kubernetes 10m Normal Started pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn Container started 10m Normal Created pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn Container created 10m Normal Pulled pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 863ms (863ms including waiting). Image size: 194589557 bytes. 10m Warning FailedMount pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w5-dd5d18-serving-cert" not found 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-dd5d18 Scaled up replica set maas-api-e2e-worker-w5-dd5d18-7b56dff9bb from 0 to 1 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb Created pod: maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv 10m Normal AddedInterface pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv Add eth0 [10.132.0.62/23] from ovn-kubernetes 10m Normal Pulled pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 814ms (814ms including waiting). Image size: 194589557 bytes. 10m Normal Started pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv Container started 10m Normal Pulling pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 10m Normal Created pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv Container created 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-9adedd Scaled up replica set maas-api-e2e-worker-w6-9adedd-75c68f8cf6 from 0 to 1 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-9adedd-75c68f8cf6 Created pod: maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs 9m59s Warning FailedMount pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w6-9adedd-serving-cert" not found 9m58s Normal AddedInterface pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs Add eth0 [10.132.0.67/23] from ovn-kubernetes 9m58s Normal Pulling pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 9m57s Normal Started pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs Container started 9m57s Normal Created pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs Container created 9m57s Normal Pulled pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 870ms (870ms including waiting). Image size: 194589557 bytes. 9m55s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-9b0f0d Scaled up replica set maas-api-e2e-worker-w2-9b0f0d-699b47bb4 from 0 to 1 9m55s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-9b0f0d-699b47bb4 Created pod: maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh 9m54s Warning FailedMount pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w2-9b0f0d-serving-cert" not found 9m53s Normal Pulling pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 9m53s Normal AddedInterface pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh Add eth0 [10.132.0.70/23] from ovn-kubernetes 9m52s Normal Created pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh Container created 9m52s Normal Started pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh Container started 9m52s Normal Pulled pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 881ms (881ms including waiting). Image size: 194589557 bytes. 9m50s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-8cf267 Scaled up replica set maas-api-e2e-worker-w1-8cf267-c97dc668d from 0 to 1 9m50s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-8cf267-c97dc668d Created pod: maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 9m49s Normal AddedInterface pod/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 Add eth0 [10.133.0.58/23] from ovn-kubernetes 9m48s Normal Pulling pod/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 9m47s Normal Started pod/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 Container started 9m47s Normal Created pod/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 Container created 9m47s Normal Pulled pod/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 1.003s (1.004s including waiting). Image size: 194589557 bytes. 9m40s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-5a27ba Scaled up replica set maas-api-e2e-worker-w3-5a27ba-7759884ddd from 0 to 1 9m40s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-5a27ba-7759884ddd Created pod: maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 9m40s Warning FailedMount pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w3-5a27ba-serving-cert" not found 9m39s Normal AddedInterface pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 Add eth0 [10.132.0.72/23] from ovn-kubernetes 9m38s Normal Pulling pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 9m38s Normal Pulled pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 796ms (796ms including waiting). Image size: 194589557 bytes. 9m38s Normal Created pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 Container created 9m38s Normal Started pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 Container started 9m35s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-e970c7-f57648c7b Created pod: maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 9m35s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-e970c7 Scaled up replica set maas-api-e2e-worker-w4-e970c7-f57648c7b from 0 to 1 9m34s Normal AddedInterface pod/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 Add eth0 [10.133.0.59/23] from ovn-kubernetes 9m34s Normal Pulling pod/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 9m33s Normal Pulled pod/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 845ms (845ms including waiting). Image size: 194589557 bytes. 9m33s Normal Created pod/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 Container created 9m33s Normal Started pod/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 Container started 5m3s Normal Pulling pod/maas-api-revoke-sub-2280dcfc-hrqc4 Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 5m3s Normal SuccessfulCreate job/maas-api-revoke-sub-2280dcfc Created pod: maas-api-revoke-sub-2280dcfc-hrqc4 5m3s Normal AddedInterface pod/maas-api-revoke-sub-2280dcfc-hrqc4 Add eth0 [10.134.0.44/23] from ovn-kubernetes 4m59s Normal SuccessfulCreate job/maas-api-revoke-sub-9709d391 Created pod: maas-api-revoke-sub-9709d391-k8q6f 4m58s Normal SuccessfulCreate job/maas-api-revoke-sub-019d8c20 Created pod: maas-api-revoke-sub-019d8c20-8xq78 4m58s Normal AddedInterface pod/maas-api-revoke-sub-9709d391-k8q6f Add eth0 [10.134.0.45/23] from ovn-kubernetes 4m58s Normal Pulling pod/maas-api-revoke-sub-9709d391-k8q6f Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 4m58s Normal Pulled pod/maas-api-revoke-sub-2280dcfc-hrqc4 Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 5.028s (5.028s including waiting). Image size: 107195206 bytes. 4m57s Normal Started pod/maas-api-revoke-sub-019d8c20-8xq78 Container started 4m57s Normal Pulled pod/maas-api-revoke-sub-019d8c20-8xq78 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m57s Normal Created pod/maas-api-revoke-sub-2280dcfc-hrqc4 Container created 4m57s Normal Created pod/maas-api-revoke-sub-019d8c20-8xq78 Container created 4m57s Normal AddedInterface pod/maas-api-revoke-sub-019d8c20-8xq78 Add eth0 [10.133.0.67/23] from ovn-kubernetes 4m57s Normal Started pod/maas-api-revoke-sub-2280dcfc-hrqc4 Container started 4m56s Normal Pulled pod/maas-api-revoke-sub-9709d391-k8q6f Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 1.723s (1.723s including waiting). Image size: 107195206 bytes. 4m56s Normal Created pod/maas-api-revoke-sub-9709d391-k8q6f Container created 4m56s Normal Started pod/maas-api-revoke-sub-9709d391-k8q6f Container started 4m56s Normal SuccessfulCreate job/maas-api-revoke-sub-69360ac7 Created pod: maas-api-revoke-sub-69360ac7-s5xt6 4m55s Normal AddedInterface pod/maas-api-revoke-sub-69360ac7-s5xt6 Add eth0 [10.134.0.46/23] from ovn-kubernetes 4m55s Normal Pulled pod/maas-api-revoke-sub-69360ac7-s5xt6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m55s Normal Created pod/maas-api-revoke-sub-69360ac7-s5xt6 Container created 4m55s Normal Started pod/maas-api-revoke-sub-69360ac7-s5xt6 Container started 4m54s Normal Completed job/maas-api-revoke-sub-2280dcfc Job completed 4m53s Normal Completed job/maas-api-revoke-sub-9709d391 Job completed 4m53s Normal Completed job/maas-api-revoke-sub-019d8c20 Job completed 4m51s Normal Completed job/maas-api-revoke-sub-69360ac7 Job completed 4m47s Normal SuccessfulCreate job/maas-api-revoke-sub-22fc67ff Created pod: maas-api-revoke-sub-22fc67ff-nn5cf 4m46s Normal Started pod/maas-api-revoke-sub-22fc67ff-nn5cf Container started 4m46s Normal Created pod/maas-api-revoke-sub-22fc67ff-nn5cf Container created 4m46s Normal Pulled pod/maas-api-revoke-sub-22fc67ff-nn5cf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m46s Normal AddedInterface pod/maas-api-revoke-sub-22fc67ff-nn5cf Add eth0 [10.134.0.47/23] from ovn-kubernetes 4m43s Normal SuccessfulCreate job/maas-api-revoke-sub-d7960fb7 Created pod: maas-api-revoke-sub-d7960fb7-ffl6g 4m43s Normal Completed job/maas-api-revoke-sub-22fc67ff Job completed 4m42s Normal AddedInterface pod/maas-api-revoke-sub-d7960fb7-ffl6g Add eth0 [10.134.0.48/23] from ovn-kubernetes 4m42s Normal Created pod/maas-api-revoke-sub-d7960fb7-ffl6g Container created 4m42s Normal Started pod/maas-api-revoke-sub-d7960fb7-ffl6g Container started 4m42s Normal Pulled pod/maas-api-revoke-sub-d7960fb7-ffl6g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m40s Normal SuccessfulCreate job/maas-api-revoke-sub-a2c552b1 Created pod: maas-api-revoke-sub-a2c552b1-b5tmg 4m39s Normal Pulled pod/maas-api-revoke-sub-a2c552b1-b5tmg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m39s Normal Created pod/maas-api-revoke-sub-a2c552b1-b5tmg Container created 4m39s Normal Started pod/maas-api-revoke-sub-a2c552b1-b5tmg Container started 4m39s Normal AddedInterface pod/maas-api-revoke-sub-a2c552b1-b5tmg Add eth0 [10.134.0.49/23] from ovn-kubernetes 4m38s Normal Completed job/maas-api-revoke-sub-d7960fb7 Job completed 4m37s Normal SuccessfulCreate job/maas-api-revoke-sub-93bc7083 Created pod: maas-api-revoke-sub-93bc7083-n998c 4m36s Normal Pulled pod/maas-api-revoke-sub-93bc7083-n998c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m36s Normal AddedInterface pod/maas-api-revoke-sub-93bc7083-n998c Add eth0 [10.134.0.50/23] from ovn-kubernetes 4m36s Normal Completed job/maas-api-revoke-sub-a2c552b1 Job completed 4m35s Normal Started pod/maas-api-revoke-sub-93bc7083-n998c Container started 4m35s Normal Created pod/maas-api-revoke-sub-93bc7083-n998c Container created 4m32s Normal Completed job/maas-api-revoke-sub-93bc7083 Job completed 4m14s Normal Killing pod/maas-api-e2e-worker-w2-9b0f0d-699b47bb4-2d8fh Stopping container maas-api 4m13s Normal Killing pod/maas-api-e2e-worker-w1-8cf267-c97dc668d-5dc67 Stopping container maas-api 4m7s Normal Killing pod/maas-api-e2e-worker-w3-5a27ba-7759884ddd-xqcv2 Stopping container maas-api 4m5s Normal Killing pod/maas-api-e2e-worker-w4-e970c7-f57648c7b-lvwp5 Stopping container maas-api 3m38s Normal SuccessfulCreate job/maas-api-revoke-sub-b545d79e Created pod: maas-api-revoke-sub-b545d79e-mtxjd 3m37s Normal AddedInterface pod/maas-api-revoke-sub-b545d79e-mtxjd Add eth0 [10.133.0.71/23] from ovn-kubernetes 3m37s Normal Pulled pod/maas-api-revoke-sub-b545d79e-mtxjd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m37s Normal Created pod/maas-api-revoke-sub-b545d79e-mtxjd Container created 3m37s Normal Started pod/maas-api-revoke-sub-b545d79e-mtxjd Container started 3m33s Normal Completed job/maas-api-revoke-sub-b545d79e Job completed 3m21s Normal Pulled pod/maas-api-revoke-sub-d5ae9488-6fg4m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m21s Normal AddedInterface pod/maas-api-revoke-sub-d5ae9488-6fg4m Add eth0 [10.133.0.72/23] from ovn-kubernetes 3m21s Normal SuccessfulCreate job/maas-api-revoke-sub-d5ae9488 Created pod: maas-api-revoke-sub-d5ae9488-6fg4m 3m20s Normal Created pod/maas-api-revoke-sub-d5ae9488-6fg4m Container created 3m20s Normal Started pod/maas-api-revoke-sub-d5ae9488-6fg4m Container started 3m17s Normal Completed job/maas-api-revoke-sub-d5ae9488 Job completed 3m7s Normal AddedInterface pod/maas-api-revoke-sub-be96d50e-bjh2b Add eth0 [10.133.0.74/23] from ovn-kubernetes 3m7s Normal Pulled pod/maas-api-revoke-sub-be96d50e-bjh2b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m7s Normal SuccessfulCreate job/maas-api-revoke-sub-be96d50e Created pod: maas-api-revoke-sub-be96d50e-bjh2b 3m6s Normal Created pod/maas-api-revoke-sub-be96d50e-bjh2b Container created 3m6s Normal Started pod/maas-api-revoke-sub-be96d50e-bjh2b Container started 3m4s Normal SuccessfulCreate job/maas-api-revoke-sub-740b5291 Created pod: maas-api-revoke-sub-740b5291-zrc6q 3m4s Normal Killing pod/maas-api-e2e-worker-w0-e34b54-7cd5778bcb-c6vdn Stopping container maas-api 3m4s Normal AddedInterface pod/maas-api-revoke-sub-740b5291-zrc6q Add eth0 [10.134.0.53/23] from ovn-kubernetes 3m3s Normal Completed job/maas-api-revoke-sub-be96d50e Job completed 3m3s Normal Pulled pod/maas-api-revoke-sub-740b5291-zrc6q Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m3s Normal Started pod/maas-api-revoke-sub-740b5291-zrc6q Container started 3m3s Normal Created pod/maas-api-revoke-sub-740b5291-zrc6q Container created 3m Normal Completed job/maas-api-revoke-sub-740b5291 Job completed 2m54s Normal SuccessfulCreate job/maas-api-revoke-sub-c70a9c61 Created pod: maas-api-revoke-sub-c70a9c61-wnj2l 2m53s Normal AddedInterface pod/maas-api-revoke-sub-c70a9c61-wnj2l Add eth0 [10.133.0.75/23] from ovn-kubernetes 2m53s Normal Pulled pod/maas-api-revoke-sub-c70a9c61-wnj2l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m52s Normal Created pod/maas-api-revoke-sub-c70a9c61-wnj2l Container created 2m52s Normal Started pod/maas-api-revoke-sub-c70a9c61-wnj2l Container started 2m50s Normal Completed job/maas-api-revoke-sub-c70a9c61 Job completed 2m46s Normal SuccessfulCreate job/maas-api-revoke-sub-e24ba4ae Created pod: maas-api-revoke-sub-e24ba4ae-k44tw 2m45s Normal AddedInterface pod/maas-api-revoke-sub-e24ba4ae-k44tw Add eth0 [10.133.0.76/23] from ovn-kubernetes 2m45s Normal Created pod/maas-api-revoke-sub-e24ba4ae-k44tw Container created 2m45s Normal Pulled pod/maas-api-revoke-sub-e24ba4ae-k44tw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m44s Normal Started pod/maas-api-revoke-sub-e24ba4ae-k44tw Container started 2m42s Normal Killing pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-bggcs Stopping container maas-api 2m41s Normal Completed job/maas-api-revoke-sub-e24ba4ae Job completed 2m35s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-9adedd Scaled up replica set maas-api-e2e-worker-w6-9adedd-75c68f8cf6 from 0 to 1 2m35s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-9adedd-75c68f8cf6 Created pod: maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg 2m35s Warning FailedMount pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w6-9adedd-serving-cert" not found 2m34s Normal AddedInterface pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg Add eth0 [10.132.0.84/23] from ovn-kubernetes 2m33s Normal Pulling pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg Pulling image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" 2m33s Normal Pulled pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg Successfully pulled image "quay.io/opendatahub/maas-api:08858542cd3bba18175e02ba9b8418547f22ade2" in 908ms (908ms including waiting). Image size: 194589557 bytes. 2m32s Normal Created pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg Container created 2m32s Normal Started pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg Container started 2m22s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w6-9adedd Created pod: maas-api-revoke-keys-e2e-worker-w6-9adedd-lvckt 2m22s Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w6-9adedd-lvckt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m22s Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w6-9adedd-lvckt Add eth0 [10.133.0.79/23] from ovn-kubernetes 2m21s Normal Created pod/maas-api-revoke-keys-e2e-worker-w6-9adedd-lvckt Container created 2m21s Normal Started pod/maas-api-revoke-keys-e2e-worker-w6-9adedd-lvckt Container started 2m20s Normal Killing pod/maas-api-e2e-worker-w5-dd5d18-7b56dff9bb-gj4rv Stopping container maas-api 2m18s Normal Completed job/maas-api-revoke-keys-e2e-worker-w6-9adedd Job completed 2m3s Normal Killing pod/maas-api-e2e-worker-w6-9adedd-75c68f8cf6-qdwsg Stopping container maas-api