=== events in odh-ai-gateway-infra (2026-11-02T23:01:21Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 12m Normal Scheduled pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 to ip-10-0-140-221.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-028b1a3f-g4f29 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-028b1a3f-g4f29 to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp to ip-10-0-130-41.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-4f0c0451-zzq7j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4f0c0451-zzq7j to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-4b5ff70e-w8n8f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4b5ff70e-w8n8f to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-51342356-s9kc8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-51342356-s9kc8 to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-53a95627-zn6j2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-53a95627-zn6j2 to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-56e240e2-49286 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-56e240e2-49286 to ip-10-0-143-75.us-west-2.compute.internal 8m47s Normal Scheduled pod/maas-api-5bb6546495-szj6q Successfully assigned odh-ai-gateway-infra/maas-api-5bb6546495-szj6q to ip-10-0-130-41.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 to ip-10-0-140-221.us-west-2.compute.internal 18m Normal Scheduled pod/maas-api-revoke-sub-5a29efb3-q42qv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-q42qv to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-5e44456b-8gwcp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5e44456b-8gwcp to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-664d0c6d-gzjgk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-664d0c6d-gzjgk to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-66600c7d-rs5lx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-66600c7d-rs5lx to ip-10-0-143-75.us-west-2.compute.internal 50m Normal Scheduled pod/postgres-7cdbf6dc44-4bckh Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-4bckh to ip-10-0-143-75.us-west-2.compute.internal 3m34s Normal Scheduled pod/maas-api-revoke-sub-6b19338f-cbcn2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-cbcn2 to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-70d300a2-vn2w4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-70d300a2-vn2w4 to ip-10-0-143-75.us-west-2.compute.internal 32m Normal Scheduled pod/maas-api-revoke-sub-72b6680a-l8n59 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-72b6680a-l8n59 to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w to ip-10-0-143-75.us-west-2.compute.internal 49m Normal Scheduled pod/maas-api-6d669c7fcd-k74jd Successfully assigned odh-ai-gateway-infra/maas-api-6d669c7fcd-k74jd to ip-10-0-130-41.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-74121fcd-2c9sn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-74121fcd-2c9sn to ip-10-0-130-41.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-77b63bd6-tfrsc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-77b63bd6-tfrsc to ip-10-0-143-75.us-west-2.compute.internal 9m55s Normal Scheduled pod/maas-api-revoke-sub-452b6d7b-ttb8g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-ttb8g to ip-10-0-143-75.us-west-2.compute.internal 32m Normal Scheduled pod/maas-api-revoke-sub-445bfe47-mkv5r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-445bfe47-mkv5r to ip-10-0-143-75.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-410664e3-x5pkb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-410664e3-x5pkb to ip-10-0-143-75.us-west-2.compute.internal 9m30s Normal Scheduled pod/maas-api-revoke-sub-3e31a506-f7kfr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-f7kfr to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-3e2ab4dd-gbv4n Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e2ab4dd-gbv4n to ip-10-0-143-75.us-west-2.compute.internal 16m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 to ip-10-0-143-75.us-west-2.compute.internal 81s Normal Scheduled pod/maas-api-key-cleanup-29894340-b8ch4 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29894340-b8ch4 to ip-10-0-143-75.us-west-2.compute.internal 8m39s Normal Scheduled pod/maas-api-86c65979d7-j5zvc Successfully assigned odh-ai-gateway-infra/maas-api-86c65979d7-j5zvc to ip-10-0-130-41.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-78e58370-vdcwn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-78e58370-vdcwn to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-7f1542e5-qr4ks Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7f1542e5-qr4ks to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-db36b079-88m8j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-db36b079-88m8j to ip-10-0-143-75.us-west-2.compute.internal 8m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-e0efc115-z7f7l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e0efc115-z7f7l to ip-10-0-143-75.us-west-2.compute.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-fb670683-wrq82 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fb670683-wrq82 to ip-10-0-143-75.us-west-2.compute.internal 8m47s Normal Scheduled pod/maas-api-86c65979d7-v94d5 Successfully assigned odh-ai-gateway-infra/maas-api-86c65979d7-v94d5 to ip-10-0-140-221.us-west-2.compute.internal 5m22s Normal Scheduled pod/maas-api-revoke-keys-e2e-authcfg-http-9d4413-ghg8n Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-9d4413-ghg8n to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-ff92eb48-gh68h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ff92eb48-gh68h to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-derive-2e86dfb1-wbw5g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e86dfb1-wbw5g to ip-10-0-143-75.us-west-2.compute.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-migrate-2663d62e-8pwwf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2663d62e-8pwwf to ip-10-0-143-75.us-west-2.compute.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-bb1a7ce7-7qtgv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bb1a7ce7-7qtgv to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 to ip-10-0-143-75.us-west-2.compute.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-a8baae-kmvjp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-a8baae-kmvjp to ip-10-0-143-75.us-west-2.compute.internal 32m Normal Scheduled pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n to ip-10-0-130-41.us-west-2.compute.internal 11m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-c86709-4z4ct Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-c86709-4z4ct to ip-10-0-143-75.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-fcc6b28e-2nmsf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fcc6b28e-2nmsf to ip-10-0-143-75.us-west-2.compute.internal 26m Normal Scheduled pod/maas-api-revoke-sub-fab95197-9cfwj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fab95197-9cfwj to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-f83b946d-x6gmq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f83b946d-x6gmq to ip-10-0-143-75.us-west-2.compute.internal 29m Normal Scheduled pod/maas-api-revoke-sub-f74292b7-ddtqw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f74292b7-ddtqw to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-f1fb8ae3-fcxfg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f1fb8ae3-fcxfg to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-revoke-sub-f0e10957-c4r4l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f0e10957-c4r4l to ip-10-0-143-75.us-west-2.compute.internal 4m15s Normal Scheduled pod/maas-api-revoke-sub-f03629db-zmtw8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-zmtw8 to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-eeecc3bd-whd96 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-eeecc3bd-whd96 to ip-10-0-143-75.us-west-2.compute.internal 32m Normal Scheduled pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-db36b079-56967d848d-rbhwq to ip-10-0-130-41.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-ee26d52d-7s4zb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ee26d52d-7s4zb to ip-10-0-143-75.us-west-2.compute.internal 23m Normal Scheduled pod/maas-api-revoke-sub-ec843018-xzqjx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-xzqjx to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-ebc7b724-d9f24 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ebc7b724-d9f24 to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w0-711bd4-flsqm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-711bd4-flsqm to ip-10-0-143-75.us-west-2.compute.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w1-ca85db-zv69x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-ca85db-zv69x to ip-10-0-143-75.us-west-2.compute.internal 26m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w2-8263a4-z2m6j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-8263a4-z2m6j to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w3-98a222-pgw95 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-98a222-pgw95 to ip-10-0-143-75.us-west-2.compute.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w4-3224ea-nml5p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-3224ea-nml5p to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w5-fe810f-lbfqz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-fe810f-lbfqz to ip-10-0-143-75.us-west-2.compute.internal 8m31s Normal Scheduled pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 to ip-10-0-140-221.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-ea1484f6-gwbpx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ea1484f6-gwbpx to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w6-49a557-fbvc2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-49a557-fbvc2 to ip-10-0-143-75.us-west-2.compute.internal 3m46s Normal Scheduled pod/maas-api-revoke-sub-0165d7d2-kxl2q Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-kxl2q to ip-10-0-143-75.us-west-2.compute.internal 21m Normal Scheduled pod/maas-api-revoke-sub-79805ca9-47wjr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-47wjr to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v to ip-10-0-130-41.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-226e008e-55v7z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-226e008e-55v7z to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-e6fee2d8-2m9jl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e6fee2d8-2m9jl to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-e41fff3b-mg8v2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e41fff3b-mg8v2 to ip-10-0-143-75.us-west-2.compute.internal 30m Normal Scheduled pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp to ip-10-0-140-221.us-west-2.compute.internal 19m Normal Scheduled pod/maas-api-revoke-sub-e2fc9c5b-g4wxv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-g4wxv to ip-10-0-143-75.us-west-2.compute.internal 22m Normal Scheduled pod/maas-api-revoke-sub-046e1343-c5vks Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-c5vks to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-074e9677-87msc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-074e9677-87msc to ip-10-0-143-75.us-west-2.compute.internal 20m Normal Scheduled pod/maas-api-revoke-sub-0b7e8edb-9tsr5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-9tsr5 to ip-10-0-143-75.us-west-2.compute.internal 29m Normal Scheduled pod/maas-api-revoke-sub-0bedd8c4-498jx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0bedd8c4-498jx to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-0e11d791-kf28m Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0e11d791-kf28m to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-0f60d85a-d4fjv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0f60d85a-d4fjv to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-df893d0b-s9qzc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-df893d0b-s9qzc to ip-10-0-143-75.us-west-2.compute.internal 13m Normal Scheduled pod/maas-api-revoke-sub-d576e68b-kpnrh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-kpnrh to ip-10-0-143-75.us-west-2.compute.internal 7m21s Normal Scheduled pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp to ip-10-0-140-221.us-west-2.compute.internal 22m Normal Scheduled pod/maas-api-revoke-sub-d3fba056-k4mtz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-k4mtz to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-d3ac0ac9-r69lb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3ac0ac9-r69lb to ip-10-0-143-75.us-west-2.compute.internal 13m Normal Scheduled pod/maas-api-revoke-sub-d2bc93bc-j25nt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-j25nt to ip-10-0-143-75.us-west-2.compute.internal 26m Normal Scheduled pod/maas-api-revoke-sub-0f9bcf4d-2j5jg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0f9bcf4d-2j5jg to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-11a045f2-b7dzp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-11a045f2-b7dzp to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-11c1d5f1-88s8g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-11c1d5f1-88s8g to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-12c5a20a-dtngj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-12c5a20a-dtngj to ip-10-0-143-75.us-west-2.compute.internal 41m Normal Scheduled pod/maas-api-revoke-sub-1f341310-cs6bv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1f341310-cs6bv to ip-10-0-143-75.us-west-2.compute.internal 32m Normal Scheduled pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk to ip-10-0-140-221.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-cd3d5118-mns4f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cd3d5118-mns4f to ip-10-0-143-75.us-west-2.compute.internal 36m Normal Scheduled pod/maas-api-revoke-sub-cbec0d9b-p9r9g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cbec0d9b-p9r9g to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-c8ada716-28mwc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c8ada716-28mwc to ip-10-0-143-75.us-west-2.compute.internal 24m Normal Scheduled pod/maas-api-revoke-sub-c1e271a9-kzjqb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kzjqb to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-bf43f723-vx8vx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bf43f723-vx8vx to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-79fc36ea-pzkmq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79fc36ea-pzkmq to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-7b5ceffc-jhspk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7b5ceffc-jhspk to ip-10-0-143-75.us-west-2.compute.internal 18m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-p2k8k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-p2k8k to ip-10-0-143-75.us-west-2.compute.internal 20m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-gbrvf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-gbrvf to ip-10-0-143-75.us-west-2.compute.internal 30m Normal Scheduled pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b Successfully assigned odh-ai-gateway-infra/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b to ip-10-0-140-221.us-west-2.compute.internal 20m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-g45lt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-g45lt to ip-10-0-143-75.us-west-2.compute.internal 15m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-9998c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9998c to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-be817925-4cltf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-be817925-4cltf to ip-10-0-143-75.us-west-2.compute.internal 30m Normal Scheduled pod/maas-api-revoke-sub-229108f6-nmwtv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-229108f6-nmwtv to ip-10-0-143-75.us-west-2.compute.internal 16m Normal Scheduled pod/maas-api-key-cleanup-29894325-ll9qf Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29894325-ll9qf to ip-10-0-130-41.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-395e0025-5jn8j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-395e0025-5jn8j to ip-10-0-143-75.us-west-2.compute.internal 11m Normal Scheduled pod/maas-api-revoke-sub-337c8ec2-69q4k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-337c8ec2-69q4k to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-7e7208d9-w7g88 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7e7208d9-w7g88 to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-80f32035-lmmhs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-80f32035-lmmhs to ip-10-0-143-75.us-west-2.compute.internal 30m Normal Scheduled pod/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 to ip-10-0-140-221.us-west-2.compute.internal 41m Normal Scheduled pod/maas-api-revoke-sub-bc1530f7-fbkzd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bc1530f7-fbkzd to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-b93686c3-972dj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b93686c3-972dj to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-b81f6b7b-5przp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b81f6b7b-5przp to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-b42cbaaf-k4w2c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b42cbaaf-k4w2c to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-af46f522-vxtkv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-af46f522-vxtkv to ip-10-0-143-75.us-west-2.compute.internal 22m Normal Scheduled pod/maas-api-revoke-sub-ae594979-pl6h5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-pl6h5 to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-a4f91c03-qg2wb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a4f91c03-qg2wb to ip-10-0-130-41.us-west-2.compute.internal 21m Normal Scheduled pod/maas-api-revoke-sub-a4aef7d7-2rv2x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2rv2x to ip-10-0-143-75.us-west-2.compute.internal 17m Normal Scheduled pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 to ip-10-0-140-221.us-west-2.compute.internal 16m Normal Scheduled pod/maas-api-revoke-sub-9d7d3240-9jk72 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9d7d3240-9jk72 to ip-10-0-143-75.us-west-2.compute.internal 9m Normal Scheduled pod/maas-api-revoke-sub-831829d9-q8m8c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-831829d9-q8m8c to ip-10-0-143-75.us-west-2.compute.internal 25m Normal Scheduled pod/maas-api-revoke-sub-85237e45-9jpm2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-9jpm2 to ip-10-0-143-75.us-west-2.compute.internal 35m Normal Scheduled pod/maas-api-revoke-sub-8704f258-lrl5d Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8704f258-lrl5d to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-87aa09ae-msgkf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-87aa09ae-msgkf to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-29894310-pzh8j Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29894310-pzh8j to ip-10-0-143-75.us-west-2.compute.internal 46m Normal Scheduled pod/maas-api-key-cleanup-29894295-md8wg Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29894295-md8wg to ip-10-0-143-75.us-west-2.compute.internal 41m Normal Scheduled pod/maas-api-revoke-sub-9b69049a-w4ns9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9b69049a-w4ns9 to ip-10-0-143-75.us-west-2.compute.internal 28m Normal Scheduled pod/maas-api-revoke-sub-21cb776d-xrgr9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-21cb776d-xrgr9 to ip-10-0-143-75.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-026aaab9-trrtj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-026aaab9-trrtj to ip-10-0-143-75.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj to ip-10-0-143-75.us-west-2.compute.internal 44m Normal Scheduled pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp to ip-10-0-130-41.us-west-2.compute.internal 31m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v to ip-10-0-130-41.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-2360b032-jjcwv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2360b032-jjcwv to ip-10-0-143-75.us-west-2.compute.internal 34m Normal Scheduled pod/maas-api-revoke-sub-2951dd58-rbldq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2951dd58-rbldq to ip-10-0-143-75.us-west-2.compute.internal 39m Normal Scheduled pod/maas-api-revoke-sub-97ef7566-9sqvk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-97ef7566-9sqvk to ip-10-0-143-75.us-west-2.compute.internal 33m Normal Scheduled pod/maas-api-revoke-sub-29fde503-xf8nf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-29fde503-xf8nf to ip-10-0-143-75.us-west-2.compute.internal 48m Normal Scheduled pod/maas-api-5bb6546495-c4r29 Successfully assigned odh-ai-gateway-infra/maas-api-5bb6546495-c4r29 to ip-10-0-140-221.us-west-2.compute.internal 44m Normal Scheduled pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 to ip-10-0-140-221.us-west-2.compute.internal 44m Normal Scheduled pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 to ip-10-0-130-41.us-west-2.compute.internal 23m Normal Scheduled pod/maas-api-revoke-sub-2e1f5b5f-mn4kp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-mn4kp to ip-10-0-143-75.us-west-2.compute.internal 44m Normal Scheduled pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c to ip-10-0-140-221.us-west-2.compute.internal 40m Normal Scheduled pod/maas-api-revoke-sub-8ba68aa3-n4rv5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8ba68aa3-n4rv5 to ip-10-0-143-75.us-west-2.compute.internal 43m Normal Scheduled pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 to ip-10-0-140-221.us-west-2.compute.internal 44m Normal Scheduled pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl to ip-10-0-130-41.us-west-2.compute.internal 43m Normal Scheduled pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 to ip-10-0-140-221.us-west-2.compute.internal 50m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 50m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-4bckh 50m Normal AddedInterface pod/postgres-7cdbf6dc44-4bckh Add eth0 [10.133.0.24/23] from ovn-kubernetes 50m Normal Pulling pod/postgres-7cdbf6dc44-4bckh Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 50m Normal Pulled pod/postgres-7cdbf6dc44-4bckh Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 6.859s (6.859s including waiting). Image size: 403732708 bytes. 50m Normal Created pod/postgres-7cdbf6dc44-4bckh Container created 50m Normal Started pod/postgres-7cdbf6dc44-4bckh Container started 49m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-6d669c7fcd from 0 to 1 49m Normal SuccessfulCreate replicaset/maas-api-6d669c7fcd Created pod: maas-api-6d669c7fcd-k74jd 49m Warning FailedCreate replicaset/maas-api-6d669c7fcd Error creating: pods "maas-api-6d669c7fcd-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 49m Normal Pulling pod/maas-api-6d669c7fcd-k74jd Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 49m Normal AddedInterface pod/maas-api-6d669c7fcd-k74jd Add eth0 [10.132.0.41/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-6d669c7fcd-k74jd Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 2.195s (2.195s including waiting). Image size: 194581366 bytes. 49m Normal Created pod/maas-api-6d669c7fcd-k74jd Container created 49m Normal Started pod/maas-api-6d669c7fcd-k74jd Container started 48m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-5bb6546495 from 0 to 1 48m Normal SuccessfulCreate replicaset/maas-api-5bb6546495 Created pod: maas-api-5bb6546495-c4r29 48m Normal Pulling pod/maas-api-5bb6546495-c4r29 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 48m Normal AddedInterface pod/maas-api-5bb6546495-c4r29 Add eth0 [10.134.0.43/23] from ovn-kubernetes 48m Normal Created pod/maas-api-5bb6546495-c4r29 Container created 48m Normal Pulled pod/maas-api-5bb6546495-c4r29 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.105s (3.105s including waiting). Image size: 194581366 bytes. 48m Normal Started pod/maas-api-5bb6546495-c4r29 Container started 48m Normal SuccessfulDelete replicaset/maas-api-6d669c7fcd Deleted pod: maas-api-6d669c7fcd-k74jd 48m Normal Killing pod/maas-api-6d669c7fcd-k74jd Stopping container maas-api 48m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-6d669c7fcd from 1 to 0 46m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29894295 46m Normal SuccessfulCreate job/maas-api-key-cleanup-29894295 Created pod: maas-api-key-cleanup-29894295-md8wg 46m Normal Pulling pod/maas-api-key-cleanup-29894295-md8wg Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 46m Normal AddedInterface pod/maas-api-key-cleanup-29894295-md8wg Add eth0 [10.133.0.34/23] from ovn-kubernetes 46m Normal Pulled pod/maas-api-key-cleanup-29894295-md8wg Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 7.606s (7.606s including waiting). Image size: 107195206 bytes. 45m Normal Pulled pod/maas-api-key-cleanup-29894295-md8wg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Created pod/maas-api-key-cleanup-29894295-md8wg Container created 45m Normal Started pod/maas-api-key-cleanup-29894295-md8wg Container started 45m Normal SuccessfulDelete job/maas-api-key-cleanup-29894295 Deleted pod: maas-api-key-cleanup-29894295-md8wg 45m Warning BackOff pod/maas-api-key-cleanup-29894295-md8wg Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29894295-md8wg_odh-ai-gateway-infra(21e89062-4201-4e08-ad46-45e905e18fdf) 45m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29894295 Job has reached the specified backoff limit 45m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29894295, condition: Failed 44m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-49a557-849f49fb54 Created pod: maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp 44m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-49a557 Scaled up replica set maas-api-e2e-worker-w6-49a557-849f49fb54 from 0 to 1 44m Warning FailedMount pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w6-49a557-serving-cert" not found 44m Normal Pulling pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 44m Normal AddedInterface pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp Add eth0 [10.132.0.49/23] from ovn-kubernetes 44m Normal Pulled pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 835ms (835ms including waiting). Image size: 194581366 bytes. 44m Normal Created pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp Container created 44m Normal Started pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp Container started 44m Warning FailedMount pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w5-fe810f-serving-cert" not found 44m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-fe810f-5c9464b7fb Created pod: maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 44m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-fe810f Scaled up replica set maas-api-e2e-worker-w5-fe810f-5c9464b7fb from 0 to 1 44m Normal Pulling pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 44m Normal AddedInterface pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 Add eth0 [10.134.0.56/23] from ovn-kubernetes 44m Normal Started pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 Container started 44m Normal Created pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 Container created 44m Normal Pulled pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 935ms (935ms including waiting). Image size: 194581366 bytes. 44m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-3224ea Scaled up replica set maas-api-e2e-worker-w4-3224ea-78cfb6ddcb from 0 to 1 44m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb Created pod: maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c 44m Warning FailedMount pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w4-3224ea-serving-cert" not found 44m Normal AddedInterface pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c Add eth0 [10.134.0.57/23] from ovn-kubernetes 44m Normal Pulling pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 44m Normal Started pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c Container started 44m Normal Created pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c Container created 44m Normal Pulled pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 906ms (906ms including waiting). Image size: 194581366 bytes. 44m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-711bd4-84d5499c78 Created pod: maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 44m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-711bd4 Scaled up replica set maas-api-e2e-worker-w0-711bd4-84d5499c78 from 0 to 1 44m Warning FailedMount pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w0-711bd4-serving-cert" not found 44m Normal AddedInterface pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 Add eth0 [10.132.0.51/23] from ovn-kubernetes 44m Normal Pulling pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 44m Normal Pulled pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 928ms (928ms including waiting). Image size: 194581366 bytes. 44m Normal Started pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 Container started 44m Normal Created pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 Container created 44m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-8263a4-5679777899 Created pod: maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl 44m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-8263a4 Scaled up replica set maas-api-e2e-worker-w2-8263a4-5679777899 from 0 to 1 44m Warning FailedMount pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w2-8263a4-serving-cert" not found 44m Normal Pulling pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 44m Normal AddedInterface pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl Add eth0 [10.132.0.52/23] from ovn-kubernetes 44m Normal Started pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl Container started 44m Normal Created pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl Container created 44m Normal Pulled pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.008s (1.008s including waiting). Image size: 194581366 bytes. 44m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-98a222-7b46f76c56 Created pod: maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 44m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-98a222 Scaled up replica set maas-api-e2e-worker-w3-98a222-7b46f76c56 from 0 to 1 43m Warning FailedMount pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w3-98a222-serving-cert" not found 43m Normal AddedInterface pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 Add eth0 [10.134.0.59/23] from ovn-kubernetes 43m Normal Pulling pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 43m Normal Started pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 Container started 43m Normal Created pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 Container created 43m Normal Pulled pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 883ms (883ms including waiting). Image size: 194581366 bytes. 43m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-ca85db-6ddbf7d965 Created pod: maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 43m Warning FailedMount pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w1-ca85db-serving-cert" not found 43m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-ca85db Scaled up replica set maas-api-e2e-worker-w1-ca85db-6ddbf7d965 from 0 to 1 43m Normal Pulling pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 43m Normal AddedInterface pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 Add eth0 [10.134.0.60/23] from ovn-kubernetes 43m Normal Created pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 Container created 43m Normal Pulled pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 970ms (970ms including waiting). Image size: 194581366 bytes. 43m Normal Started pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 Container started 41m Normal SuccessfulCreate job/maas-api-revoke-sub-9b69049a Created pod: maas-api-revoke-sub-9b69049a-w4ns9 41m Normal AddedInterface pod/maas-api-revoke-sub-9b69049a-w4ns9 Add eth0 [10.133.0.55/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-revoke-sub-9b69049a-w4ns9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Created pod/maas-api-revoke-sub-9b69049a-w4ns9 Container created 41m Normal Started pod/maas-api-revoke-sub-9b69049a-w4ns9 Container started 41m Normal Completed job/maas-api-revoke-sub-9b69049a Job completed 41m Normal SuccessfulCreate job/maas-api-revoke-sub-bc1530f7 Created pod: maas-api-revoke-sub-bc1530f7-fbkzd 41m Normal Pulled pod/maas-api-revoke-sub-bc1530f7-fbkzd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal AddedInterface pod/maas-api-revoke-sub-bc1530f7-fbkzd Add eth0 [10.133.0.57/23] from ovn-kubernetes 41m Normal Created pod/maas-api-revoke-sub-bc1530f7-fbkzd Container created 41m Normal Started pod/maas-api-revoke-sub-bc1530f7-fbkzd Container started 41m Normal Completed job/maas-api-revoke-sub-bc1530f7 Job completed 41m Normal AddedInterface pod/maas-api-revoke-sub-1f341310-cs6bv Add eth0 [10.133.0.58/23] from ovn-kubernetes 41m Normal SuccessfulCreate job/maas-api-revoke-sub-1f341310 Created pod: maas-api-revoke-sub-1f341310-cs6bv 41m Normal Pulled pod/maas-api-revoke-sub-1f341310-cs6bv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Started pod/maas-api-revoke-sub-1f341310-cs6bv Container started 41m Normal Created pod/maas-api-revoke-sub-1f341310-cs6bv Container created 40m Normal Completed job/maas-api-revoke-sub-1f341310 Job completed 40m Normal AddedInterface pod/maas-api-revoke-sub-8ba68aa3-n4rv5 Add eth0 [10.133.0.59/23] from ovn-kubernetes 40m Normal SuccessfulCreate job/maas-api-revoke-sub-8ba68aa3 Created pod: maas-api-revoke-sub-8ba68aa3-n4rv5 40m Normal Started pod/maas-api-revoke-sub-8ba68aa3-n4rv5 Container started 40m Normal Pulled pod/maas-api-revoke-sub-8ba68aa3-n4rv5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal SuccessfulCreate job/maas-api-revoke-sub-4f0c0451 Created pod: maas-api-revoke-sub-4f0c0451-zzq7j 40m Normal Created pod/maas-api-revoke-sub-8ba68aa3-n4rv5 Container created 40m Normal Pulled pod/maas-api-revoke-sub-4f0c0451-zzq7j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Created pod/maas-api-revoke-sub-4f0c0451-zzq7j Container created 40m Normal Started pod/maas-api-revoke-sub-4f0c0451-zzq7j Container started 40m Normal AddedInterface pod/maas-api-revoke-sub-4f0c0451-zzq7j Add eth0 [10.133.0.60/23] from ovn-kubernetes 40m Normal Completed job/maas-api-revoke-sub-8ba68aa3 Job completed 40m Normal Completed job/maas-api-revoke-sub-4f0c0451 Job completed 40m Normal SuccessfulCreate job/maas-api-revoke-sub-410664e3 Created pod: maas-api-revoke-sub-410664e3-x5pkb 40m Normal Pulled pod/maas-api-revoke-sub-410664e3-x5pkb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/maas-api-revoke-sub-410664e3-x5pkb Add eth0 [10.133.0.61/23] from ovn-kubernetes 40m Normal Started pod/maas-api-revoke-sub-410664e3-x5pkb Container started 40m Normal Created pod/maas-api-revoke-sub-410664e3-x5pkb Container created 40m Normal AddedInterface pod/maas-api-revoke-sub-cd3d5118-mns4f Add eth0 [10.133.0.62/23] from ovn-kubernetes 40m Normal SuccessfulCreate job/maas-api-revoke-sub-cd3d5118 Created pod: maas-api-revoke-sub-cd3d5118-mns4f 40m Normal Pulled pod/maas-api-revoke-sub-cd3d5118-mns4f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Completed job/maas-api-revoke-sub-410664e3 Job completed 40m Normal Created pod/maas-api-revoke-sub-cd3d5118-mns4f Container created 40m Normal Started pod/maas-api-revoke-sub-cd3d5118-mns4f Container started 40m Normal Completed job/maas-api-revoke-sub-cd3d5118 Job completed 40m Normal SuccessfulCreate job/maas-api-revoke-sub-fcc6b28e Created pod: maas-api-revoke-sub-fcc6b28e-2nmsf 40m Normal AddedInterface pod/maas-api-revoke-sub-fcc6b28e-2nmsf Add eth0 [10.133.0.65/23] from ovn-kubernetes 40m Normal Pulled pod/maas-api-revoke-sub-fcc6b28e-2nmsf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Created pod/maas-api-revoke-sub-fcc6b28e-2nmsf Container created 40m Normal Started pod/maas-api-revoke-sub-fcc6b28e-2nmsf Container started 40m Normal SuccessfulCreate job/maas-api-revoke-sub-026aaab9 Created pod: maas-api-revoke-sub-026aaab9-trrtj 40m Normal Completed job/maas-api-revoke-sub-fcc6b28e Job completed 40m Normal Created pod/maas-api-revoke-sub-026aaab9-trrtj Container created 40m Normal Pulled pod/maas-api-revoke-sub-026aaab9-trrtj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Started pod/maas-api-revoke-sub-026aaab9-trrtj Container started 40m Normal AddedInterface pod/maas-api-revoke-sub-026aaab9-trrtj Add eth0 [10.133.0.66/23] from ovn-kubernetes 40m Normal Completed job/maas-api-revoke-sub-026aaab9 Job completed 40m Normal SuccessfulCreate job/maas-api-revoke-sub-2360b032 Created pod: maas-api-revoke-sub-2360b032-jjcwv 40m Normal Pulled pod/maas-api-revoke-sub-2360b032-jjcwv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Created pod/maas-api-revoke-sub-2360b032-jjcwv Container created 40m Normal SuccessfulCreate job/maas-api-revoke-sub-ea1484f6 Created pod: maas-api-revoke-sub-ea1484f6-gwbpx 40m Normal Started pod/maas-api-revoke-sub-2360b032-jjcwv Container started 40m Normal AddedInterface pod/maas-api-revoke-sub-2360b032-jjcwv Add eth0 [10.133.0.67/23] from ovn-kubernetes 40m Normal Pulled pod/maas-api-revoke-sub-ea1484f6-gwbpx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal AddedInterface pod/maas-api-revoke-sub-ea1484f6-gwbpx Add eth0 [10.133.0.68/23] from ovn-kubernetes 40m Normal Started pod/maas-api-revoke-sub-ea1484f6-gwbpx Container started 40m Normal Created pod/maas-api-revoke-sub-ea1484f6-gwbpx Container created 39m Normal SuccessfulCreate job/maas-api-revoke-sub-7b5ceffc Created pod: maas-api-revoke-sub-7b5ceffc-jhspk 39m Normal Pulled pod/maas-api-revoke-sub-7b5ceffc-jhspk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Started pod/maas-api-revoke-sub-7b5ceffc-jhspk Container started 39m Normal Completed job/maas-api-revoke-sub-2360b032 Job completed 39m Normal AddedInterface pod/maas-api-revoke-sub-7b5ceffc-jhspk Add eth0 [10.133.0.69/23] from ovn-kubernetes 39m Normal Created pod/maas-api-revoke-sub-7b5ceffc-jhspk Container created 39m Normal Completed job/maas-api-revoke-sub-ea1484f6 Job completed 39m Normal SuccessfulCreate job/maas-api-revoke-sub-df893d0b Created pod: maas-api-revoke-sub-df893d0b-s9qzc 39m Normal AddedInterface pod/maas-api-revoke-sub-df893d0b-s9qzc Add eth0 [10.133.0.70/23] from ovn-kubernetes 39m Normal Completed job/maas-api-revoke-sub-7b5ceffc Job completed 39m Normal Pulled pod/maas-api-revoke-sub-df893d0b-s9qzc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Created pod/maas-api-revoke-sub-df893d0b-s9qzc Container created 39m Normal Started pod/maas-api-revoke-sub-df893d0b-s9qzc Container started 39m Normal Completed job/maas-api-revoke-sub-df893d0b Job completed 39m Normal SuccessfulCreate job/maas-api-revoke-sub-e6fee2d8 Created pod: maas-api-revoke-sub-e6fee2d8-2m9jl 39m Normal Pulled pod/maas-api-revoke-sub-e6fee2d8-2m9jl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Created pod/maas-api-revoke-sub-e6fee2d8-2m9jl Container created 39m Normal Started pod/maas-api-revoke-sub-e6fee2d8-2m9jl Container started 39m Normal AddedInterface pod/maas-api-revoke-sub-e6fee2d8-2m9jl Add eth0 [10.133.0.71/23] from ovn-kubernetes 39m Normal SuccessfulCreate job/maas-api-revoke-sub-be817925 Created pod: maas-api-revoke-sub-be817925-4cltf 39m Normal Started pod/maas-api-revoke-sub-be817925-4cltf Container started 39m Normal Created pod/maas-api-revoke-sub-be817925-4cltf Container created 39m Normal AddedInterface pod/maas-api-revoke-sub-be817925-4cltf Add eth0 [10.133.0.72/23] from ovn-kubernetes 39m Normal Completed job/maas-api-revoke-sub-e6fee2d8 Job completed 39m Normal SuccessfulCreate job/maas-api-revoke-sub-77b63bd6 Created pod: maas-api-revoke-sub-77b63bd6-tfrsc 39m Normal Pulled pod/maas-api-revoke-sub-be817925-4cltf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/maas-api-revoke-sub-77b63bd6-tfrsc Add eth0 [10.133.0.73/23] from ovn-kubernetes 39m Normal Pulled pod/maas-api-revoke-sub-77b63bd6-tfrsc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Started pod/maas-api-revoke-sub-77b63bd6-tfrsc Container started 39m Normal Created pod/maas-api-revoke-sub-77b63bd6-tfrsc Container created 39m Normal SuccessfulCreate job/maas-api-revoke-sub-97ef7566 Created pod: maas-api-revoke-sub-97ef7566-9sqvk 39m Normal Completed job/maas-api-revoke-sub-be817925 Job completed 39m Normal AddedInterface pod/maas-api-revoke-sub-97ef7566-9sqvk Add eth0 [10.133.0.74/23] from ovn-kubernetes 39m Normal Pulled pod/maas-api-revoke-sub-97ef7566-9sqvk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Started pod/maas-api-revoke-sub-97ef7566-9sqvk Container started 39m Normal Created pod/maas-api-revoke-sub-97ef7566-9sqvk Container created 39m Normal Completed job/maas-api-revoke-sub-77b63bd6 Job completed 39m Normal Completed job/maas-api-revoke-sub-97ef7566 Job completed 39m Normal AddedInterface pod/maas-api-revoke-sub-028b1a3f-g4f29 Add eth0 [10.133.0.77/23] from ovn-kubernetes 39m Normal SuccessfulCreate job/maas-api-revoke-sub-028b1a3f Created pod: maas-api-revoke-sub-028b1a3f-g4f29 39m Normal Created pod/maas-api-revoke-sub-028b1a3f-g4f29 Container created 39m Normal Pulled pod/maas-api-revoke-sub-028b1a3f-g4f29 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Started pod/maas-api-revoke-sub-028b1a3f-g4f29 Container started 39m Normal SuccessfulCreate job/maas-api-revoke-sub-ff92eb48 Created pod: maas-api-revoke-sub-ff92eb48-gh68h 39m Normal Pulled pod/maas-api-revoke-sub-ff92eb48-gh68h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/maas-api-revoke-sub-ff92eb48-gh68h Add eth0 [10.133.0.78/23] from ovn-kubernetes 39m Normal Created pod/maas-api-revoke-sub-ff92eb48-gh68h Container created 39m Normal Started pod/maas-api-revoke-sub-ff92eb48-gh68h Container started 39m Normal Completed job/maas-api-revoke-sub-028b1a3f Job completed 39m Normal Completed job/maas-api-revoke-sub-ff92eb48 Job completed 39m Normal AddedInterface pod/maas-api-revoke-sub-87aa09ae-msgkf Add eth0 [10.133.0.79/23] from ovn-kubernetes 39m Normal SuccessfulCreate job/maas-api-revoke-sub-87aa09ae Created pod: maas-api-revoke-sub-87aa09ae-msgkf 39m Normal Created pod/maas-api-revoke-sub-87aa09ae-msgkf Container created 39m Normal Pulled pod/maas-api-revoke-sub-87aa09ae-msgkf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Started pod/maas-api-revoke-sub-87aa09ae-msgkf Container started 39m Normal Completed job/maas-api-revoke-sub-87aa09ae Job completed 39m Normal AddedInterface pod/maas-api-revoke-sub-664d0c6d-gzjgk Add eth0 [10.133.0.80/23] from ovn-kubernetes 39m Normal Pulled pod/maas-api-revoke-sub-664d0c6d-gzjgk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal SuccessfulCreate job/maas-api-revoke-sub-664d0c6d Created pod: maas-api-revoke-sub-664d0c6d-gzjgk 39m Normal Created pod/maas-api-revoke-sub-664d0c6d-gzjgk Container created 39m Normal Started pod/maas-api-revoke-sub-664d0c6d-gzjgk Container started 39m Normal Completed job/maas-api-revoke-sub-664d0c6d Job completed 36m Normal SuccessfulCreate job/maas-api-revoke-sub-cbec0d9b Created pod: maas-api-revoke-sub-cbec0d9b-p9r9g 36m Normal Created pod/maas-api-revoke-sub-cbec0d9b-p9r9g Container created 36m Normal AddedInterface pod/maas-api-revoke-sub-cbec0d9b-p9r9g Add eth0 [10.133.0.90/23] from ovn-kubernetes 36m Normal Pulled pod/maas-api-revoke-sub-cbec0d9b-p9r9g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 36m Normal Started pod/maas-api-revoke-sub-cbec0d9b-p9r9g Container started 36m Normal Completed job/maas-api-revoke-sub-cbec0d9b Job completed 35m Normal SuccessfulCreate job/maas-api-revoke-sub-b93686c3 Created pod: maas-api-revoke-sub-b93686c3-972dj 35m Normal Started pod/maas-api-revoke-sub-b93686c3-972dj Container started 35m Normal Created pod/maas-api-revoke-sub-b93686c3-972dj Container created 35m Normal Pulled pod/maas-api-revoke-sub-b93686c3-972dj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/maas-api-revoke-sub-b93686c3-972dj Add eth0 [10.133.0.94/23] from ovn-kubernetes 35m Normal SuccessfulCreate job/maas-api-revoke-sub-7e7208d9 Created pod: maas-api-revoke-sub-7e7208d9-w7g88 35m Normal Completed job/maas-api-revoke-sub-b93686c3 Job completed 35m Normal Pulled pod/maas-api-revoke-sub-7e7208d9-w7g88 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/maas-api-revoke-sub-7e7208d9-w7g88 Add eth0 [10.133.0.95/23] from ovn-kubernetes 35m Normal Started pod/maas-api-revoke-sub-7e7208d9-w7g88 Container started 35m Normal Created pod/maas-api-revoke-sub-7e7208d9-w7g88 Container created 35m Normal Completed job/maas-api-revoke-sub-7e7208d9 Job completed 35m Normal Pulled pod/maas-api-revoke-sub-8704f258-lrl5d Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/maas-api-revoke-sub-8704f258-lrl5d Add eth0 [10.133.0.96/23] from ovn-kubernetes 35m Normal SuccessfulCreate job/maas-api-revoke-sub-8704f258 Created pod: maas-api-revoke-sub-8704f258-lrl5d 35m Normal Created pod/maas-api-revoke-sub-8704f258-lrl5d Container created 35m Normal Started pod/maas-api-revoke-sub-8704f258-lrl5d Container started 35m Normal Completed job/maas-api-revoke-sub-8704f258 Job completed 35m Normal SuccessfulCreate job/maas-api-revoke-sub-0f60d85a Created pod: maas-api-revoke-sub-0f60d85a-d4fjv 35m Normal Pulled pod/maas-api-revoke-sub-0f60d85a-d4fjv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/maas-api-revoke-sub-0f60d85a-d4fjv Add eth0 [10.133.0.98/23] from ovn-kubernetes 35m Normal Started pod/maas-api-revoke-sub-0f60d85a-d4fjv Container started 35m Normal Created pod/maas-api-revoke-sub-0f60d85a-d4fjv Container created 35m Normal SuccessfulCreate job/maas-api-revoke-sub-11c1d5f1 Created pod: maas-api-revoke-sub-11c1d5f1-88s8g 35m Normal AddedInterface pod/maas-api-revoke-sub-11c1d5f1-88s8g Add eth0 [10.133.0.101/23] from ovn-kubernetes 35m Normal Started pod/maas-api-revoke-sub-11c1d5f1-88s8g Container started 35m Normal Created pod/maas-api-revoke-sub-11c1d5f1-88s8g Container created 35m Normal Pulled pod/maas-api-revoke-sub-11c1d5f1-88s8g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal Completed job/maas-api-revoke-sub-0f60d85a Job completed 35m Normal Completed job/maas-api-revoke-sub-11c1d5f1 Job completed 35m Normal Pulled pod/maas-api-revoke-sub-80f32035-lmmhs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal SuccessfulCreate job/maas-api-revoke-sub-80f32035 Created pod: maas-api-revoke-sub-80f32035-lmmhs 35m Normal AddedInterface pod/maas-api-revoke-sub-80f32035-lmmhs Add eth0 [10.133.0.102/23] from ovn-kubernetes 35m Normal Created pod/maas-api-revoke-sub-80f32035-lmmhs Container created 35m Normal Started pod/maas-api-revoke-sub-80f32035-lmmhs Container started 35m Normal AddedInterface pod/maas-api-revoke-sub-b42cbaaf-k4w2c Add eth0 [10.133.0.103/23] from ovn-kubernetes 35m Normal SuccessfulCreate job/maas-api-revoke-sub-b42cbaaf Created pod: maas-api-revoke-sub-b42cbaaf-k4w2c 35m Normal Started pod/maas-api-revoke-sub-b42cbaaf-k4w2c Container started 35m Normal Created pod/maas-api-revoke-sub-b42cbaaf-k4w2c Container created 35m Normal Pulled pod/maas-api-revoke-sub-b42cbaaf-k4w2c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal Completed job/maas-api-revoke-sub-80f32035 Job completed 35m Normal Completed job/maas-api-revoke-sub-b42cbaaf Job completed 35m Normal SuccessfulCreate job/maas-api-revoke-sub-f83b946d Created pod: maas-api-revoke-sub-f83b946d-x6gmq 35m Normal Created pod/maas-api-revoke-sub-f83b946d-x6gmq Container created 35m Normal Started pod/maas-api-revoke-sub-f83b946d-x6gmq Container started 35m Normal Pulled pod/maas-api-revoke-sub-f83b946d-x6gmq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/maas-api-revoke-sub-f83b946d-x6gmq Add eth0 [10.133.0.104/23] from ovn-kubernetes 35m Normal AddedInterface pod/maas-api-revoke-sub-0e11d791-kf28m Add eth0 [10.133.0.105/23] from ovn-kubernetes 35m Normal SuccessfulCreate job/maas-api-revoke-sub-0e11d791 Created pod: maas-api-revoke-sub-0e11d791-kf28m 34m Normal Pulled pod/maas-api-revoke-sub-0e11d791-kf28m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Created pod/maas-api-revoke-sub-0e11d791-kf28m Container created 34m Normal Started pod/maas-api-revoke-sub-0e11d791-kf28m Container started 34m Normal Completed job/maas-api-revoke-sub-f83b946d Job completed 34m Normal Completed job/maas-api-revoke-sub-0e11d791 Job completed 34m Normal SuccessfulCreate job/maas-api-revoke-sub-d3ac0ac9 Created pod: maas-api-revoke-sub-d3ac0ac9-r69lb 34m Normal AddedInterface pod/maas-api-revoke-sub-d3ac0ac9-r69lb Add eth0 [10.133.0.109/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-d3ac0ac9-r69lb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Started pod/maas-api-revoke-sub-d3ac0ac9-r69lb Container started 34m Normal Created pod/maas-api-revoke-sub-d3ac0ac9-r69lb Container created 34m Normal SuccessfulCreate job/maas-api-revoke-sub-11a045f2 Created pod: maas-api-revoke-sub-11a045f2-b7dzp 34m Normal Created pod/maas-api-revoke-sub-11a045f2-b7dzp Container created 34m Normal AddedInterface pod/maas-api-revoke-sub-11a045f2-b7dzp Add eth0 [10.133.0.110/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-11a045f2-b7dzp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Started pod/maas-api-revoke-sub-11a045f2-b7dzp Container started 34m Normal SuccessfulCreate job/maas-api-revoke-sub-79fc36ea Created pod: maas-api-revoke-sub-79fc36ea-pzkmq 34m Normal SuccessfulCreate job/maas-api-revoke-sub-eeecc3bd Created pod: maas-api-revoke-sub-eeecc3bd-whd96 34m Normal AddedInterface pod/maas-api-revoke-sub-79fc36ea-pzkmq Add eth0 [10.133.0.111/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-79fc36ea-pzkmq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Started pod/maas-api-revoke-sub-79fc36ea-pzkmq Container started 34m Normal Completed job/maas-api-revoke-sub-d3ac0ac9 Job completed 34m Normal AddedInterface pod/maas-api-revoke-sub-eeecc3bd-whd96 Add eth0 [10.133.0.112/23] from ovn-kubernetes 34m Normal Created pod/maas-api-revoke-sub-79fc36ea-pzkmq Container created 34m Normal Pulled pod/maas-api-revoke-sub-eeecc3bd-whd96 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Created pod/maas-api-revoke-sub-eeecc3bd-whd96 Container created 34m Normal Started pod/maas-api-revoke-sub-eeecc3bd-whd96 Container started 34m Normal Completed job/maas-api-revoke-sub-11a045f2 Job completed 34m Normal Completed job/maas-api-revoke-sub-eeecc3bd Job completed 34m Normal Completed job/maas-api-revoke-sub-79fc36ea Job completed 34m Normal SuccessfulCreate job/maas-api-revoke-sub-2951dd58 Created pod: maas-api-revoke-sub-2951dd58-rbldq 34m Normal SuccessfulCreate job/maas-api-revoke-sub-ee26d52d Created pod: maas-api-revoke-sub-ee26d52d-7s4zb 34m Normal Pulled pod/maas-api-revoke-sub-ee26d52d-7s4zb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Pulled pod/maas-api-revoke-sub-2951dd58-rbldq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/maas-api-revoke-sub-2951dd58-rbldq Add eth0 [10.133.0.113/23] from ovn-kubernetes 34m Normal AddedInterface pod/maas-api-revoke-sub-ee26d52d-7s4zb Add eth0 [10.133.0.114/23] from ovn-kubernetes 34m Normal Started pod/maas-api-revoke-sub-ee26d52d-7s4zb Container started 34m Normal Created pod/maas-api-revoke-sub-ee26d52d-7s4zb Container created 34m Normal Created pod/maas-api-revoke-sub-2951dd58-rbldq Container created 34m Normal Started pod/maas-api-revoke-sub-2951dd58-rbldq Container started 34m Normal SuccessfulCreate job/maas-api-revoke-sub-4b5ff70e Created pod: maas-api-revoke-sub-4b5ff70e-w8n8f 34m Normal SuccessfulCreate job/maas-api-revoke-sub-53a95627 Created pod: maas-api-revoke-sub-53a95627-zn6j2 34m Normal AddedInterface pod/maas-api-revoke-sub-4b5ff70e-w8n8f Add eth0 [10.133.0.115/23] from ovn-kubernetes 34m Normal Created pod/maas-api-revoke-sub-53a95627-zn6j2 Container created 34m Normal Completed job/maas-api-revoke-sub-ee26d52d Job completed 34m Normal Pulled pod/maas-api-revoke-sub-53a95627-zn6j2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Started pod/maas-api-revoke-sub-53a95627-zn6j2 Container started 34m Normal AddedInterface pod/maas-api-revoke-sub-53a95627-zn6j2 Add eth0 [10.133.0.116/23] from ovn-kubernetes 34m Normal Completed job/maas-api-revoke-sub-2951dd58 Job completed 34m Normal Created pod/maas-api-revoke-sub-4b5ff70e-w8n8f Container created 34m Normal Started pod/maas-api-revoke-sub-4b5ff70e-w8n8f Container started 34m Normal Pulled pod/maas-api-revoke-sub-4b5ff70e-w8n8f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal SuccessfulCreate job/maas-api-revoke-sub-5e44456b Created pod: maas-api-revoke-sub-5e44456b-8gwcp 34m Normal Started pod/maas-api-revoke-sub-5e44456b-8gwcp Container started 34m Normal Created pod/maas-api-revoke-sub-5e44456b-8gwcp Container created 34m Normal Pulled pod/maas-api-revoke-sub-5e44456b-8gwcp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/maas-api-revoke-sub-5e44456b-8gwcp Add eth0 [10.133.0.117/23] from ovn-kubernetes 34m Normal SuccessfulCreate job/maas-api-revoke-sub-12c5a20a Created pod: maas-api-revoke-sub-12c5a20a-dtngj 34m Normal Created pod/maas-api-revoke-sub-12c5a20a-dtngj Container created 34m Normal Started pod/maas-api-revoke-sub-12c5a20a-dtngj Container started 34m Normal AddedInterface pod/maas-api-revoke-sub-12c5a20a-dtngj Add eth0 [10.133.0.118/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-12c5a20a-dtngj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Completed job/maas-api-revoke-sub-4b5ff70e Job completed 34m Normal Completed job/maas-api-revoke-sub-53a95627 Job completed 34m Normal Completed job/maas-api-revoke-sub-5e44456b Job completed 34m Normal Completed job/maas-api-revoke-sub-12c5a20a Job completed 34m Normal SuccessfulCreate job/maas-api-revoke-sub-e41fff3b Created pod: maas-api-revoke-sub-e41fff3b-mg8v2 34m Normal Started pod/maas-api-revoke-sub-e41fff3b-mg8v2 Container started 34m Normal Created pod/maas-api-revoke-sub-e41fff3b-mg8v2 Container created 34m Normal Pulled pod/maas-api-revoke-sub-e41fff3b-mg8v2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/maas-api-revoke-sub-e41fff3b-mg8v2 Add eth0 [10.133.0.119/23] from ovn-kubernetes 34m Normal SuccessfulCreate job/maas-api-revoke-sub-226e008e Created pod: maas-api-revoke-sub-226e008e-55v7z 34m Normal AddedInterface pod/maas-api-revoke-sub-226e008e-55v7z Add eth0 [10.133.0.120/23] from ovn-kubernetes 34m Normal Started pod/maas-api-revoke-sub-226e008e-55v7z Container started 34m Normal Pulled pod/maas-api-revoke-sub-226e008e-55v7z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Created pod/maas-api-revoke-sub-226e008e-55v7z Container created 34m Normal Completed job/maas-api-revoke-sub-e41fff3b Job completed 34m Normal AddedInterface pod/maas-api-revoke-sub-78e58370-vdcwn Add eth0 [10.133.0.121/23] from ovn-kubernetes 34m Normal SuccessfulCreate job/maas-api-revoke-sub-78e58370 Created pod: maas-api-revoke-sub-78e58370-vdcwn 34m Normal Created pod/maas-api-revoke-sub-78e58370-vdcwn Container created 34m Normal Completed job/maas-api-revoke-sub-226e008e Job completed 34m Normal Pulled pod/maas-api-revoke-sub-78e58370-vdcwn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Started pod/maas-api-revoke-sub-78e58370-vdcwn Container started 34m Normal SuccessfulCreate job/maas-api-revoke-sub-66600c7d Created pod: maas-api-revoke-sub-66600c7d-rs5lx 34m Normal Started pod/maas-api-revoke-sub-66600c7d-rs5lx Container started 34m Normal Created pod/maas-api-revoke-sub-66600c7d-rs5lx Container created 34m Normal Pulled pod/maas-api-revoke-sub-66600c7d-rs5lx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/maas-api-revoke-sub-66600c7d-rs5lx Add eth0 [10.133.0.122/23] from ovn-kubernetes 34m Normal Completed job/maas-api-revoke-sub-78e58370 Job completed 34m Normal Completed job/maas-api-revoke-sub-66600c7d Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-sub-29fde503 Created pod: maas-api-revoke-sub-29fde503-xf8nf 33m Normal SuccessfulCreate job/maas-api-revoke-sub-3e2ab4dd Created pod: maas-api-revoke-sub-3e2ab4dd-gbv4n 33m Normal SuccessfulCreate job/maas-api-revoke-sub-ebc7b724 Created pod: maas-api-revoke-sub-ebc7b724-d9f24 33m Normal SuccessfulCreate job/maas-api-revoke-sub-395e0025 Created pod: maas-api-revoke-sub-395e0025-5jn8j 33m Normal AddedInterface pod/maas-api-revoke-sub-29fde503-xf8nf Add eth0 [10.133.0.130/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-sub-ebc7b724-d9f24 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-sub-3e2ab4dd-gbv4n Add eth0 [10.133.0.132/23] from ovn-kubernetes 33m Normal AddedInterface pod/maas-api-revoke-sub-ebc7b724-d9f24 Add eth0 [10.133.0.133/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-sub-395e0025-5jn8j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-sub-395e0025-5jn8j Add eth0 [10.133.0.135/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-sub-3e2ab4dd-gbv4n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Started pod/maas-api-revoke-sub-29fde503-xf8nf Container started 33m Normal Pulled pod/maas-api-revoke-sub-29fde503-xf8nf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Created pod/maas-api-revoke-sub-29fde503-xf8nf Container created 33m Normal Created pod/maas-api-revoke-sub-ebc7b724-d9f24 Container created 33m Normal Started pod/maas-api-revoke-sub-395e0025-5jn8j Container started 33m Normal Created pod/maas-api-revoke-sub-3e2ab4dd-gbv4n Container created 33m Normal Created pod/maas-api-revoke-sub-395e0025-5jn8j Container created 33m Normal Started pod/maas-api-revoke-sub-3e2ab4dd-gbv4n Container started 33m Normal Started pod/maas-api-revoke-sub-ebc7b724-d9f24 Container started 33m Normal Completed job/maas-api-revoke-sub-29fde503 Job completed 33m Normal Completed job/maas-api-revoke-sub-ebc7b724 Job completed 33m Normal Completed job/maas-api-revoke-sub-3e2ab4dd Job completed 33m Normal Completed job/maas-api-revoke-sub-395e0025 Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-sub-c8ada716 Created pod: maas-api-revoke-sub-c8ada716-28mwc 33m Normal SuccessfulCreate job/maas-api-revoke-sub-bf43f723 Created pod: maas-api-revoke-sub-bf43f723-vx8vx 33m Normal AddedInterface pod/maas-api-revoke-sub-c8ada716-28mwc Add eth0 [10.133.0.136/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-sub-c8ada716-28mwc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Created pod/maas-api-revoke-sub-c8ada716-28mwc Container created 33m Normal Started pod/maas-api-revoke-sub-c8ada716-28mwc Container started 33m Normal Pulled pod/maas-api-revoke-sub-bf43f723-vx8vx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-sub-bf43f723-vx8vx Add eth0 [10.133.0.137/23] from ovn-kubernetes 33m Normal Created pod/maas-api-revoke-sub-bf43f723-vx8vx Container created 33m Normal Started pod/maas-api-revoke-sub-bf43f723-vx8vx Container started 33m Normal AddedInterface pod/maas-api-revoke-sub-af46f522-vxtkv Add eth0 [10.133.0.138/23] from ovn-kubernetes 33m Normal SuccessfulCreate job/maas-api-revoke-sub-af46f522 Created pod: maas-api-revoke-sub-af46f522-vxtkv 33m Normal Pulled pod/maas-api-revoke-sub-af46f522-vxtkv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Started pod/maas-api-revoke-sub-af46f522-vxtkv Container started 33m Normal Created pod/maas-api-revoke-sub-af46f522-vxtkv Container created 33m Normal Completed job/maas-api-revoke-sub-c8ada716 Job completed 33m Normal Completed job/maas-api-revoke-sub-bf43f723 Job completed 33m Normal Completed job/maas-api-revoke-sub-af46f522 Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w0-711bd4 Created pod: maas-api-revoke-keys-e2e-worker-w0-711bd4-flsqm 33m Normal SuccessfulCreate job/maas-api-revoke-sub-b81f6b7b Created pod: maas-api-revoke-sub-b81f6b7b-5przp 33m Normal Started pod/maas-api-revoke-sub-b81f6b7b-5przp Container started 33m Normal Pulled pod/maas-api-revoke-sub-b81f6b7b-5przp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-sub-b81f6b7b-5przp Add eth0 [10.133.0.141/23] from ovn-kubernetes 33m Normal Created pod/maas-api-revoke-sub-b81f6b7b-5przp Container created 33m Normal Started pod/maas-api-revoke-keys-e2e-worker-w0-711bd4-flsqm Container started 33m Normal Created pod/maas-api-revoke-keys-e2e-worker-w0-711bd4-flsqm Container created 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w0-711bd4-flsqm Add eth0 [10.133.0.140/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w0-711bd4-flsqm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Completed job/maas-api-revoke-sub-b81f6b7b Job completed 32m Normal Completed job/maas-api-revoke-keys-e2e-worker-w0-711bd4 Job completed 32m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-7f1542e5-5f9f7b8d66 Created pod: maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n 32m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-7f1542e5 Scaled up replica set maas-api-e2e-ait-7f1542e5-5f9f7b8d66 from 0 to 1 32m Warning FailedMount pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-7f1542e5-serving-cert" not found 32m Normal Pulling pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 32m Normal AddedInterface pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n Add eth0 [10.132.0.90/23] from ovn-kubernetes 32m Normal Started pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n Container started 32m Normal Created pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n Container created 32m Normal Pulled pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 918ms (918ms including waiting). Image size: 194581366 bytes. 32m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-db36b079-56967d848d Created pod: maas-api-e2e-ait-db36b079-56967d848d-rbhwq 32m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-db36b079 Scaled up replica set maas-api-e2e-ait-db36b079-56967d848d from 0 to 1 32m Warning FailedMount pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-db36b079-serving-cert" not found 32m Normal Pulling pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 32m Normal AddedInterface pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq Add eth0 [10.132.0.91/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.392s (1.392s including waiting). Image size: 194581366 bytes. 32m Normal Created pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq Container created 32m Normal Started pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq Container started 32m Normal SuccessfulCreate job/maas-api-revoke-sub-445bfe47 Created pod: maas-api-revoke-sub-445bfe47-mkv5r 32m Normal SuccessfulCreate job/maas-api-revoke-sub-72b6680a Created pod: maas-api-revoke-sub-72b6680a-l8n59 32m Normal Pulled pod/maas-api-revoke-sub-72b6680a-l8n59 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/maas-api-revoke-sub-72b6680a-l8n59 Add eth0 [10.133.0.145/23] from ovn-kubernetes 32m Normal AddedInterface pod/maas-api-revoke-sub-445bfe47-mkv5r Add eth0 [10.133.0.144/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-445bfe47-mkv5r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Created pod/maas-api-revoke-sub-72b6680a-l8n59 Container created 32m Normal Started pod/maas-api-revoke-sub-72b6680a-l8n59 Container started 32m Normal Started pod/maas-api-revoke-sub-445bfe47-mkv5r Container started 32m Normal Created pod/maas-api-revoke-sub-445bfe47-mkv5r Container created 32m Normal Completed job/maas-api-revoke-sub-445bfe47 Job completed 32m Warning FailedMount pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-derive-2e86dfb1-serving-cert" not found 32m Normal SuccessfulCreate replicaset/maas-api-e2e-derive-2e86dfb1-64bd579cc6 Created pod: maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk 32m Normal ScalingReplicaSet deployment/maas-api-e2e-derive-2e86dfb1 Scaled up replica set maas-api-e2e-derive-2e86dfb1-64bd579cc6 from 0 to 1 32m Normal Completed job/maas-api-revoke-sub-72b6680a Job completed 32m Normal AddedInterface pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk Add eth0 [10.134.0.94/23] from ovn-kubernetes 32m Normal Pulling pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 32m Normal Pulled pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.055s (1.055s including waiting). Image size: 194581366 bytes. 32m Normal Started pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk Container started 32m Normal Created pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk Container created 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-7f1542e5 Created pod: maas-api-revoke-keys-e2e-ait-7f1542e5-qr4ks 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-7f1542e5-qr4ks Add eth0 [10.133.0.149/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-7f1542e5-qr4ks Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Started pod/maas-api-revoke-keys-e2e-ait-7f1542e5-qr4ks Container started 31m Normal Created pod/maas-api-revoke-keys-e2e-ait-7f1542e5-qr4ks Container created 31m Normal Completed job/maas-api-revoke-keys-e2e-ait-7f1542e5 Job completed 31m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-db36b079-88m8j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-db36b079-88m8j Add eth0 [10.133.0.150/23] from ovn-kubernetes 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-db36b079 Created pod: maas-api-revoke-keys-e2e-ait-db36b079-88m8j 31m Normal Started pod/maas-api-revoke-keys-e2e-ait-db36b079-88m8j Container started 31m Normal Created pod/maas-api-revoke-keys-e2e-ait-db36b079-88m8j Container created 31m Normal Completed job/maas-api-revoke-keys-e2e-ait-db36b079 Job completed 31m Normal Killing pod/maas-api-e2e-worker-w0-711bd4-84d5499c78-xbnq5 Stopping container maas-api 31m Normal SuccessfulCreate job/maas-api-revoke-sub-f0e10957 Created pod: maas-api-revoke-sub-f0e10957-c4r4l 31m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Add eth0 [10.132.0.100/23] from ovn-kubernetes 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h Add eth0 [10.133.0.152/23] from ovn-kubernetes 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-98a222 Created job maas-api-key-cleanup-e2e-worker-w3-98a222-29894310 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-ait-db36b079-29894310 Created pod: maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-ait-db36b079 Created job maas-api-key-cleanup-e2e-ait-db36b079-29894310 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Add eth0 [10.132.0.99/23] from ovn-kubernetes 31m Normal SuccessfulCreate job/maas-api-key-cleanup-29894310 Created pod: maas-api-key-cleanup-29894310-pzh8j 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj Add eth0 [10.133.0.154/23] from ovn-kubernetes 31m Normal Pulling pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 31m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-fe810f Created job maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Add eth0 [10.132.0.98/23] from ovn-kubernetes 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310 Created pod: maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310 Created pod: maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310 Created pod: maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-derive-2e86dfb1 Created job maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Add eth0 [10.134.0.96/23] from ovn-kubernetes 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310 Created pod: maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310 Created pod: maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310 Created pod: maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x 31m Normal Pulling pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-49a557 Created job maas-api-key-cleanup-e2e-worker-w6-49a557-29894310 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310 Created pod: maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v 31m Normal Started pod/maas-api-revoke-sub-f0e10957-c4r4l Container started 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-ca85db Created job maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-8263a4 Created job maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-ait-7f1542e5 Created job maas-api-key-cleanup-e2e-ait-7f1542e5-29894310 31m Normal Created pod/maas-api-revoke-sub-f0e10957-c4r4l Container created 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29894310 31m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-3224ea Created job maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310 31m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310 Created pod: maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v 31m Normal Pulled pod/maas-api-revoke-sub-f0e10957-c4r4l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-f0e10957-c4r4l Add eth0 [10.133.0.151/23] from ovn-kubernetes 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w Add eth0 [10.133.0.157/23] from ovn-kubernetes 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 Add eth0 [10.133.0.155/23] from ovn-kubernetes 31m Normal AddedInterface pod/maas-api-key-cleanup-29894310-pzh8j Add eth0 [10.133.0.156/23] from ovn-kubernetes 31m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x Add eth0 [10.133.0.153/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w Container created 31m Normal Started pod/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w Container started 31m Normal Completed job/maas-api-revoke-sub-f0e10957 Job completed 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 4.871s (4.871s including waiting). Image size: 107195206 bytes. 31m Normal Pulled pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 4.897s (4.897s including waiting). Image size: 107195206 bytes. 31m Warning BackOff pod/maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-ait-7f1542e5-29894310-9ds2w_odh-ai-gateway-infra(c8e1dcad-21e3-47b0-a91f-ca1a53f037f0) 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-derive-2e86dfb1 Created pod: maas-api-revoke-keys-e2e-derive-2e86dfb1-wbw5g 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 5.39s (5.39s including waiting). Image size: 107195206 bytes. 31m Normal Pulled pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 6.106s (6.106s including waiting). Image size: 107195206 bytes. 31m Normal Started pod/maas-api-revoke-keys-e2e-derive-2e86dfb1-wbw5g Container started 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-derive-2e86dfb1-wbw5g Add eth0 [10.133.0.158/23] from ovn-kubernetes 31m Normal Created pod/maas-api-revoke-keys-e2e-derive-2e86dfb1-wbw5g Container created 31m Normal Pulled pod/maas-api-revoke-keys-e2e-derive-2e86dfb1-wbw5g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Pulled pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Started pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Container started 31m Normal Created pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Container created 31m Warning BackOff pod/maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-ait-db36b079-29894310-lgsm6_odh-ai-gateway-infra(23fb37b7-5daf-4ef7-a553-3037abfe4a81) 31m Normal Completed job/maas-api-revoke-keys-e2e-derive-2e86dfb1 Job completed 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Killing pod/maas-api-e2e-ait-7f1542e5-5f9f7b8d66-wjh7n Stopping container maas-api 31m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h Container started 31m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h Container created 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h_odh-ai-gateway-infra(ed4edae0-0933-4c33-a0c9-fdf942973660) 31m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310-wbw2h 31m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x Container created 31m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x Container started 31m Normal Pulled pod/maas-api-key-cleanup-29894310-pzh8j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x_odh-ai-gateway-infra(06158047-c5ef-4601-a2eb-1f81c543870c) 31m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-98a222-29894310-mgb6x 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Pulled pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-api-key-cleanup-29894310-pzh8j Container created 31m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310 Job has reached the specified backoff limit 31m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-3224ea Saw completed job: maas-api-key-cleanup-e2e-worker-w4-3224ea-29894310, condition: Failed 31m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj Container started 31m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj Container created 31m Normal Created pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Container created 31m Normal Started pod/maas-api-key-cleanup-29894310-pzh8j Container started 31m Normal Started pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Container started 31m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 Container created 31m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 Container started 31m Warning BackOff pod/maas-api-key-cleanup-29894310-pzh8j Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29894310-pzh8j_odh-ai-gateway-infra(94d2531f-0293-4eaa-b52d-41e23d5cf3b7) 31m Warning BackOff pod/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp_odh-ai-gateway-infra(5290c2f6-d0f8-4a67-aa29-f2b3fb63cda4) 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj_odh-ai-gateway-infra(301bca8a-2d01-4259-a40d-5ec276afa08e) 31m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Container started 31m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Container created 31m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310 Deleted pod: maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310-4vqsp 31m Normal SuccessfulDelete job/maas-api-key-cleanup-29894310 Deleted pod: maas-api-key-cleanup-29894310-pzh8j 31m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-98a222-29894310 Job has reached the specified backoff limit 31m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9_odh-ai-gateway-infra(08742801-a801-461e-b6da-c0c148426c77) 31m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310-7mpsj 31m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-49a557-29894310-w9hm9 31m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-98a222 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-98a222-29894310, condition: Failed 31m Normal Killing pod/maas-api-e2e-ait-db36b079-56967d848d-rbhwq Stopping container maas-api 30m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v_odh-ai-gateway-infra(b9bed3dd-9b4d-4b17-8c58-4edb7916762b) 30m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29894310 Job has reached the specified backoff limit 30m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Container created 30m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Container started 30m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-ca85db Saw completed job: maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310, condition: Failed 30m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-ca85db-29894310 Job has reached the specified backoff limit 30m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29894310, condition: Failed 30m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-49a557 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-49a557-29894310, condition: Failed 30m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310 Job has reached the specified backoff limit 30m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-49a557-29894310 Job has reached the specified backoff limit 30m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-derive-2e86dfb1 Saw completed job: maas-api-key-cleanup-e2e-derive-2e86dfb1-29894310, condition: Failed 30m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310-zlc6v 30m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310 Job has reached the specified backoff limit 30m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v_odh-ai-gateway-infra(b41ad331-309b-4899-98f6-5b313e554e0b) 30m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310-dz66v 30m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-8263a4 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-8263a4-29894310, condition: Failed 30m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-fe810f Saw completed job: maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310, condition: Failed 30m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-fe810f-29894310 Job has reached the specified backoff limit 30m Normal Killing pod/maas-api-e2e-derive-2e86dfb1-64bd579cc6-wlxzk Stopping container maas-api 30m Normal SuccessfulCreate job/maas-api-revoke-sub-229108f6 Created pod: maas-api-revoke-sub-229108f6-nmwtv 30m Normal AddedInterface pod/maas-api-revoke-sub-229108f6-nmwtv Add eth0 [10.133.0.160/23] from ovn-kubernetes 30m Normal Started pod/maas-api-revoke-sub-229108f6-nmwtv Container started 30m Normal Pulled pod/maas-api-revoke-sub-229108f6-nmwtv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-revoke-sub-229108f6-nmwtv Container created 30m Normal Completed job/maas-api-revoke-sub-229108f6 Job completed 30m Normal SuccessfulCreate replicaset/maas-api-e2e-migrate-2663d62e-dc8b888cd Created pod: maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b 30m Normal ScalingReplicaSet deployment/maas-api-e2e-migrate-2663d62e Scaled up replica set maas-api-e2e-migrate-2663d62e-dc8b888cd from 0 to 1 30m Warning FailedMount pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-migrate-2663d62e-serving-cert" not found 30m Normal AddedInterface pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b Add eth0 [10.134.0.97/23] from ovn-kubernetes 30m Normal Pulling pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 30m Normal Pulled pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 912ms (912ms including waiting). Image size: 194581366 bytes. 30m Normal Started pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b Container started 30m Normal Created pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b Container created 30m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-fb670683-6dc5b77 Created pod: maas-api-e2e-ait-fb670683-6dc5b77-p2qxp 30m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-fb670683 Scaled up replica set maas-api-e2e-ait-fb670683-6dc5b77 from 0 to 1 30m Warning FailedMount pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-fb670683-serving-cert" not found 30m Normal Pulling pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 30m Normal AddedInterface pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp Add eth0 [10.134.0.98/23] from ovn-kubernetes 30m Normal Started pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp Container started 30m Normal Created pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp Container created 30m Normal Pulled pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.066s (1.066s including waiting). Image size: 194581366 bytes. 30m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-bb1a7ce7 Scaled up replica set maas-api-e2e-mt-bb1a7ce7-f4bc695f4 from 0 to 1 30m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-bb1a7ce7-f4bc695f4 Created pod: maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 30m Normal AddedInterface pod/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 Add eth0 [10.134.0.99/23] from ovn-kubernetes 30m Normal Pulling pod/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 29m Normal Created pod/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 Container created 29m Normal Pulled pod/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 943ms (943ms including waiting). Image size: 194581366 bytes. 29m Normal Started pod/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 Container started 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w4-3224ea Created pod: maas-api-revoke-keys-e2e-worker-w4-3224ea-nml5p 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w1-ca85db-zv69x Add eth0 [10.133.0.168/23] from ovn-kubernetes 29m Normal Started pod/maas-api-revoke-keys-e2e-worker-w4-3224ea-nml5p Container started 29m Normal Created pod/maas-api-revoke-keys-e2e-worker-w4-3224ea-nml5p Container created 29m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w4-3224ea-nml5p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w4-3224ea-nml5p Add eth0 [10.133.0.167/23] from ovn-kubernetes 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w1-ca85db Created pod: maas-api-revoke-keys-e2e-worker-w1-ca85db-zv69x 29m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w1-ca85db-zv69x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-keys-e2e-worker-w1-ca85db-zv69x Container created 29m Normal Started pod/maas-api-revoke-keys-e2e-worker-w1-ca85db-zv69x Container started 29m Normal Completed job/maas-api-revoke-keys-e2e-worker-w4-3224ea Job completed 29m Normal Completed job/maas-api-revoke-keys-e2e-worker-w1-ca85db Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-migrate-2663d62e Created pod: maas-api-revoke-keys-e2e-migrate-2663d62e-8pwwf 29m Normal SuccessfulCreate job/maas-api-revoke-sub-f74292b7 Created pod: maas-api-revoke-sub-f74292b7-ddtqw 29m Normal SuccessfulCreate job/maas-api-revoke-sub-0bedd8c4 Created pod: maas-api-revoke-sub-0bedd8c4-498jx 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-migrate-2663d62e-8pwwf Add eth0 [10.133.0.170/23] from ovn-kubernetes 29m Normal AddedInterface pod/maas-api-revoke-sub-f74292b7-ddtqw Add eth0 [10.133.0.169/23] from ovn-kubernetes 29m Normal AddedInterface pod/maas-api-revoke-sub-0bedd8c4-498jx Add eth0 [10.133.0.171/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-sub-0bedd8c4-498jx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Started pod/maas-api-revoke-keys-e2e-migrate-2663d62e-8pwwf Container started 29m Normal Created pod/maas-api-revoke-sub-0bedd8c4-498jx Container created 29m Normal Started pod/maas-api-revoke-sub-f74292b7-ddtqw Container started 29m Normal Started pod/maas-api-revoke-sub-0bedd8c4-498jx Container started 29m Normal Pulled pod/maas-api-revoke-sub-f74292b7-ddtqw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-sub-f74292b7-ddtqw Container created 29m Normal Created pod/maas-api-revoke-keys-e2e-migrate-2663d62e-8pwwf Container created 29m Normal Pulled pod/maas-api-revoke-keys-e2e-migrate-2663d62e-8pwwf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Completed job/maas-api-revoke-sub-0bedd8c4 Job completed 29m Normal Completed job/maas-api-revoke-sub-f74292b7 Job completed 29m Normal Completed job/maas-api-revoke-keys-e2e-migrate-2663d62e Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-fb670683 Created pod: maas-api-revoke-keys-e2e-ait-fb670683-wrq82 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-fb670683-wrq82 Add eth0 [10.133.0.172/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-fb670683-wrq82 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-keys-e2e-ait-fb670683-wrq82 Container created 29m Normal Started pod/maas-api-revoke-keys-e2e-ait-fb670683-wrq82 Container started 29m Normal Completed job/maas-api-revoke-keys-e2e-ait-fb670683 Job completed 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w6-49a557-fbvc2 Add eth0 [10.133.0.173/23] from ovn-kubernetes 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w6-49a557 Created pod: maas-api-revoke-keys-e2e-worker-w6-49a557-fbvc2 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w6-49a557-fbvc2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w6-49a557-fbvc2 Container started 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w6-49a557-fbvc2 Container created 28m Normal Killing pod/maas-api-e2e-migrate-2663d62e-dc8b888cd-wn68b Stopping container maas-api 28m Normal Killing pod/maas-api-e2e-worker-w4-3224ea-78cfb6ddcb-cv92c Stopping container maas-api 28m Normal SuccessfulCreate job/maas-api-revoke-sub-f1fb8ae3 Created pod: maas-api-revoke-sub-f1fb8ae3-fcxfg 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w6-49a557 Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-56e240e2 Created pod: maas-api-revoke-sub-56e240e2-49286 28m Normal AddedInterface pod/maas-api-revoke-sub-56e240e2-49286 Add eth0 [10.133.0.174/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-f1fb8ae3-fcxfg Container created 28m Normal Pulled pod/maas-api-revoke-sub-56e240e2-49286 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-sub-f1fb8ae3-fcxfg Container started 28m Normal Pulled pod/maas-api-revoke-sub-f1fb8ae3-fcxfg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Killing pod/maas-api-e2e-ait-fb670683-6dc5b77-p2qxp Stopping container maas-api 28m Normal AddedInterface pod/maas-api-revoke-sub-f1fb8ae3-fcxfg Add eth0 [10.133.0.175/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-56e240e2-49286 Container created 28m Normal Started pod/maas-api-revoke-sub-56e240e2-49286 Container started 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w5-fe810f Created pod: maas-api-revoke-keys-e2e-worker-w5-fe810f-lbfqz 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w5-fe810f-lbfqz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w5-fe810f-lbfqz Add eth0 [10.133.0.176/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w5-fe810f-lbfqz Container started 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w5-fe810f-lbfqz Container created 28m Normal Completed job/maas-api-revoke-sub-f1fb8ae3 Job completed 28m Normal Completed job/maas-api-revoke-sub-56e240e2 Job completed 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w3-98a222-pgw95 Add eth0 [10.133.0.177/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w3-98a222-pgw95 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w3-98a222 Created pod: maas-api-revoke-keys-e2e-worker-w3-98a222-pgw95 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w3-98a222-pgw95 Container created 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w3-98a222-pgw95 Container started 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w5-fe810f Job completed 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w3-98a222 Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-21cb776d Created pod: maas-api-revoke-sub-21cb776d-xrgr9 28m Normal SuccessfulCreate job/maas-api-revoke-sub-a4f91c03 Created pod: maas-api-revoke-sub-a4f91c03-qg2wb 28m Normal SuccessfulCreate job/maas-api-revoke-sub-74121fcd Created pod: maas-api-revoke-sub-74121fcd-2c9sn 28m Normal SuccessfulCreate job/maas-api-revoke-sub-51342356 Created pod: maas-api-revoke-sub-51342356-s9kc8 28m Normal SuccessfulCreate job/maas-api-revoke-sub-70d300a2 Created pod: maas-api-revoke-sub-70d300a2-vn2w4 28m Normal Killing pod/maas-api-e2e-worker-w1-ca85db-6ddbf7d965-g4hq2 Stopping container maas-api 28m Normal AddedInterface pod/maas-api-revoke-sub-51342356-s9kc8 Add eth0 [10.133.0.178/23] from ovn-kubernetes 28m Normal SuccessfulCreate job/maas-api-revoke-sub-074e9677 Created pod: maas-api-revoke-sub-074e9677-87msc 28m Normal Pulled pod/maas-api-revoke-sub-74121fcd-2c9sn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Pulled pod/maas-api-revoke-sub-51342356-s9kc8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-70d300a2-vn2w4 Add eth0 [10.133.0.179/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-51342356-s9kc8 Container created 28m Normal Pulled pod/maas-api-revoke-sub-70d300a2-vn2w4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-sub-51342356-s9kc8 Container started 28m Normal AddedInterface pod/maas-api-revoke-sub-074e9677-87msc Add eth0 [10.133.0.181/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-a4f91c03-qg2wb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-74121fcd-2c9sn Add eth0 [10.132.0.104/23] from ovn-kubernetes 28m Normal AddedInterface pod/maas-api-revoke-sub-21cb776d-xrgr9 Add eth0 [10.133.0.180/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-21cb776d-xrgr9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-sub-74121fcd-2c9sn Container started 28m Normal AddedInterface pod/maas-api-revoke-sub-a4f91c03-qg2wb Add eth0 [10.132.0.105/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-74121fcd-2c9sn Container created 28m Normal Started pod/maas-api-revoke-sub-074e9677-87msc Container started 28m Normal Started pod/maas-api-revoke-sub-70d300a2-vn2w4 Container started 28m Normal Created pod/maas-api-revoke-sub-21cb776d-xrgr9 Container created 28m Normal Started pod/maas-api-revoke-sub-21cb776d-xrgr9 Container started 28m Normal Pulled pod/maas-api-revoke-sub-074e9677-87msc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Created pod/maas-api-revoke-sub-a4f91c03-qg2wb Container created 28m Normal Created pod/maas-api-revoke-sub-074e9677-87msc Container created 28m Normal Created pod/maas-api-revoke-sub-70d300a2-vn2w4 Container created 28m Normal Started pod/maas-api-revoke-sub-a4f91c03-qg2wb Container started 28m Normal Completed job/maas-api-revoke-sub-51342356 Job completed 28m Normal Completed job/maas-api-revoke-sub-74121fcd Job completed 28m Normal Completed job/maas-api-revoke-sub-a4f91c03 Job completed 28m Normal Completed job/maas-api-revoke-sub-21cb776d Job completed 28m Normal Completed job/maas-api-revoke-sub-70d300a2 Job completed 28m Normal Completed job/maas-api-revoke-sub-074e9677 Job completed 28m Normal Killing pod/maas-api-e2e-worker-w6-49a557-849f49fb54-g95dp Stopping container maas-api 28m Normal Killing pod/maas-api-e2e-worker-w3-98a222-7b46f76c56-6qfr4 Stopping container maas-api 28m Normal Killing pod/maas-api-e2e-worker-w5-fe810f-5c9464b7fb-24bz7 Stopping container maas-api 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-bb1a7ce7 Created pod: maas-api-revoke-keys-e2e-mt-bb1a7ce7-7qtgv 27m Normal Started pod/maas-api-revoke-keys-e2e-mt-bb1a7ce7-7qtgv Container started 27m Normal Created pod/maas-api-revoke-keys-e2e-mt-bb1a7ce7-7qtgv Container created 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-bb1a7ce7-7qtgv Add eth0 [10.133.0.182/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-bb1a7ce7-7qtgv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Completed job/maas-api-revoke-keys-e2e-mt-bb1a7ce7 Job completed 27m Normal Killing pod/maas-api-e2e-mt-bb1a7ce7-f4bc695f4-bfxn8 Stopping container maas-api 26m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w2-8263a4 Created pod: maas-api-revoke-keys-e2e-worker-w2-8263a4-z2m6j 26m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w2-8263a4-z2m6j Add eth0 [10.133.0.183/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w2-8263a4-z2m6j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-keys-e2e-worker-w2-8263a4-z2m6j Container created 26m Normal Started pod/maas-api-revoke-keys-e2e-worker-w2-8263a4-z2m6j Container started 26m Normal Completed job/maas-api-revoke-keys-e2e-worker-w2-8263a4 Job completed 26m Normal SuccessfulCreate job/maas-api-revoke-sub-0f9bcf4d Created pod: maas-api-revoke-sub-0f9bcf4d-2j5jg 26m Normal AddedInterface pod/maas-api-revoke-sub-0f9bcf4d-2j5jg Add eth0 [10.133.0.184/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-revoke-sub-fab95197-9cfwj Add eth0 [10.133.0.185/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-0f9bcf4d-2j5jg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulCreate job/maas-api-revoke-sub-fab95197 Created pod: maas-api-revoke-sub-fab95197-9cfwj 26m Normal Pulled pod/maas-api-revoke-sub-fab95197-9cfwj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-revoke-sub-0f9bcf4d-2j5jg Container started 26m Normal Created pod/maas-api-revoke-sub-0f9bcf4d-2j5jg Container created 26m Normal Started pod/maas-api-revoke-sub-fab95197-9cfwj Container started 26m Normal Created pod/maas-api-revoke-sub-fab95197-9cfwj Container created 26m Normal Completed job/maas-api-revoke-sub-0f9bcf4d Job completed 26m Normal Completed job/maas-api-revoke-sub-fab95197 Job completed 26m Normal Killing pod/maas-api-e2e-worker-w2-8263a4-5679777899-l5hbl Stopping container maas-api 25m Normal SuccessfulCreate job/maas-api-revoke-sub-85237e45 Created pod: maas-api-revoke-sub-85237e45-9jpm2 25m Normal AddedInterface pod/maas-api-revoke-sub-85237e45-9jpm2 Add eth0 [10.133.0.187/23] from ovn-kubernetes 25m Normal Pulled pod/maas-api-revoke-sub-85237e45-9jpm2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Created pod/maas-api-revoke-sub-85237e45-9jpm2 Container created 25m Normal Started pod/maas-api-revoke-sub-85237e45-9jpm2 Container started 25m Normal Completed job/maas-api-revoke-sub-85237e45 Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-c1e271a9 Created pod: maas-api-revoke-sub-c1e271a9-kzjqb 24m Normal AddedInterface pod/maas-api-revoke-sub-c1e271a9-kzjqb Add eth0 [10.133.0.189/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-sub-c1e271a9-kzjqb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal Created pod/maas-api-revoke-sub-c1e271a9-kzjqb Container created 24m Normal Started pod/maas-api-revoke-sub-c1e271a9-kzjqb Container started 24m Normal Completed job/maas-api-revoke-sub-c1e271a9 Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-2e1f5b5f Created pod: maas-api-revoke-sub-2e1f5b5f-mn4kp 23m Normal AddedInterface pod/maas-api-revoke-sub-2e1f5b5f-mn4kp Add eth0 [10.133.0.190/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-2e1f5b5f-mn4kp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Created pod/maas-api-revoke-sub-2e1f5b5f-mn4kp Container created 23m Normal Started pod/maas-api-revoke-sub-2e1f5b5f-mn4kp Container started 23m Normal Completed job/maas-api-revoke-sub-2e1f5b5f Job completed 23m Normal Pulled pod/maas-api-revoke-sub-ec843018-xzqjx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-sub-ec843018-xzqjx Add eth0 [10.133.0.191/23] from ovn-kubernetes 23m Normal SuccessfulCreate job/maas-api-revoke-sub-ec843018 Created pod: maas-api-revoke-sub-ec843018-xzqjx 23m Normal Started pod/maas-api-revoke-sub-ec843018-xzqjx Container started 23m Normal Created pod/maas-api-revoke-sub-ec843018-xzqjx Container created 23m Normal Completed job/maas-api-revoke-sub-ec843018 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-046e1343 Created pod: maas-api-revoke-sub-046e1343-c5vks 22m Normal AddedInterface pod/maas-api-revoke-sub-046e1343-c5vks Add eth0 [10.133.0.192/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-046e1343-c5vks Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-046e1343-c5vks Container created 22m Normal Started pod/maas-api-revoke-sub-046e1343-c5vks Container started 22m Normal Completed job/maas-api-revoke-sub-046e1343 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-d3fba056 Created pod: maas-api-revoke-sub-d3fba056-k4mtz 22m Normal AddedInterface pod/maas-api-revoke-sub-d3fba056-k4mtz Add eth0 [10.133.0.193/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-d3fba056-k4mtz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-d3fba056-k4mtz Container created 22m Normal Started pod/maas-api-revoke-sub-d3fba056-k4mtz Container started 22m Normal Completed job/maas-api-revoke-sub-d3fba056 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-ae594979 Created pod: maas-api-revoke-sub-ae594979-pl6h5 22m Normal AddedInterface pod/maas-api-revoke-sub-ae594979-pl6h5 Add eth0 [10.133.0.194/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-ae594979-pl6h5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-ae594979-pl6h5 Container created 22m Normal Started pod/maas-api-revoke-sub-ae594979-pl6h5 Container started 22m Normal Completed job/maas-api-revoke-sub-ae594979 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-a4aef7d7 Created pod: maas-api-revoke-sub-a4aef7d7-2rv2x 21m Normal Started pod/maas-api-revoke-sub-a4aef7d7-2rv2x Container started 21m Normal AddedInterface pod/maas-api-revoke-sub-a4aef7d7-2rv2x Add eth0 [10.133.0.195/23] from ovn-kubernetes 21m Normal Created pod/maas-api-revoke-sub-a4aef7d7-2rv2x Container created 21m Normal Pulled pod/maas-api-revoke-sub-a4aef7d7-2rv2x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Completed job/maas-api-revoke-sub-a4aef7d7 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-79805ca9 Created pod: maas-api-revoke-sub-79805ca9-47wjr 21m Normal AddedInterface pod/maas-api-revoke-sub-79805ca9-47wjr Add eth0 [10.133.0.196/23] from ovn-kubernetes 21m Normal Created pod/maas-api-revoke-sub-79805ca9-47wjr Container created 21m Normal Started pod/maas-api-revoke-sub-79805ca9-47wjr Container started 21m Normal Pulled pod/maas-api-revoke-sub-79805ca9-47wjr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Completed job/maas-api-revoke-sub-79805ca9 Job completed 20m Normal SuccessfulCreate job/maas-api-revoke-sub-0b7e8edb Created pod: maas-api-revoke-sub-0b7e8edb-9tsr5 20m Normal AddedInterface pod/maas-api-revoke-sub-0b7e8edb-9tsr5 Add eth0 [10.133.0.197/23] from ovn-kubernetes 20m Normal Pulled pod/maas-api-revoke-sub-0b7e8edb-9tsr5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal Started pod/maas-api-revoke-sub-0b7e8edb-9tsr5 Container started 20m Normal Created pod/maas-api-revoke-sub-0b7e8edb-9tsr5 Container created 20m Normal Completed job/maas-api-revoke-sub-0b7e8edb Job completed 20m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-g45lt 20m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-g45lt Add eth0 [10.133.0.198/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-sub-3d4156f1-g45lt Container started 20m Normal Created pod/maas-api-revoke-sub-3d4156f1-g45lt Container created 20m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-g45lt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 20m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-gbrvf 20m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-gbrvf Add eth0 [10.133.0.199/23] from ovn-kubernetes 20m Normal Created pod/maas-api-revoke-sub-3d4156f1-gbrvf Container created 20m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-gbrvf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal Started pod/maas-api-revoke-sub-3d4156f1-gbrvf Container started 20m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 19m Normal SuccessfulCreate job/maas-api-revoke-sub-e2fc9c5b Created pod: maas-api-revoke-sub-e2fc9c5b-g4wxv 19m Normal Pulled pod/maas-api-revoke-sub-e2fc9c5b-g4wxv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-sub-e2fc9c5b-g4wxv Add eth0 [10.133.0.200/23] from ovn-kubernetes 19m Normal Created pod/maas-api-revoke-sub-e2fc9c5b-g4wxv Container created 19m Normal Started pod/maas-api-revoke-sub-e2fc9c5b-g4wxv Container started 18m Normal Completed job/maas-api-revoke-sub-e2fc9c5b Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-sub-5a29efb3 Created pod: maas-api-revoke-sub-5a29efb3-q42qv 18m Normal Started pod/maas-api-revoke-sub-5a29efb3-q42qv Container started 18m Normal Created pod/maas-api-revoke-sub-5a29efb3-q42qv Container created 18m Normal Pulled pod/maas-api-revoke-sub-5a29efb3-q42qv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-sub-5a29efb3-q42qv Add eth0 [10.133.0.201/23] from ovn-kubernetes 18m Normal Completed job/maas-api-revoke-sub-5a29efb3 Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-p2k8k 18m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-p2k8k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-p2k8k Add eth0 [10.133.0.202/23] from ovn-kubernetes 18m Normal Started pod/maas-api-revoke-sub-3d4156f1-p2k8k Container started 18m Normal Created pod/maas-api-revoke-sub-3d4156f1-p2k8k Container created 18m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 17m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-a8baae Scaled up replica set maas-api-e2e-worker-single-main-a8baae-7796cfdbd4 from 0 to 1 17m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4 Created pod: maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 17m Warning FailedMount pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-single-main-a8baae-serving-cert" not found 17m Normal AddedInterface pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 Add eth0 [10.134.0.101/23] from ovn-kubernetes 17m Normal Pulling pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 17m Normal Started pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 Container started 17m Normal Created pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 Container created 17m Normal Pulled pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 997ms (997ms including waiting). Image size: 194581366 bytes. 16m Normal SuccessfulCreate job/maas-api-revoke-sub-9d7d3240 Created pod: maas-api-revoke-sub-9d7d3240-9jk72 16m Normal AddedInterface pod/maas-api-revoke-sub-9d7d3240-9jk72 Add eth0 [10.133.0.205/23] from ovn-kubernetes 16m Normal Pulled pod/maas-api-revoke-sub-9d7d3240-9jk72 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal Started pod/maas-api-revoke-sub-9d7d3240-9jk72 Container started 16m Normal Created pod/maas-api-revoke-sub-9d7d3240-9jk72 Container created 16m Normal Completed job/maas-api-revoke-sub-9d7d3240 Job completed 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-a8baae Created pod: maas-api-revoke-keys-e2e-worker-single-main-a8baae-kmvjp 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-a8baae-kmvjp Add eth0 [10.133.0.206/23] from ovn-kubernetes 16m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-a8baae-kmvjp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-a8baae-kmvjp Container created 16m Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-a8baae-kmvjp Container started 16m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29894325 16m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 Add eth0 [10.133.0.207/23] from ovn-kubernetes 16m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-single-main-a8baae Created job maas-api-key-cleanup-e2e-worker-single-main-a8baae-29894325 16m Normal SuccessfulCreate job/maas-api-key-cleanup-29894325 Created pod: maas-api-key-cleanup-29894325-ll9qf 16m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-single-main-a8baae-29894325 Created pod: maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 16m Normal AddedInterface pod/maas-api-key-cleanup-29894325-ll9qf Add eth0 [10.132.0.107/23] from ovn-kubernetes 16m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal Created pod/maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 Container created 16m Normal Started pod/maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 Container started 16m Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-a8baae Job completed 16m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-single-main-a8baae-2989432qbbj5_odh-ai-gateway-infra(90a687ec-6988-4e6c-a8b7-bd0e5fe45026) 16m Normal Killing pod/maas-api-e2e-worker-single-main-a8baae-7796cfdbd4-ln6m9 Stopping container maas-api 16m Normal Pulled pod/maas-api-key-cleanup-29894325-ll9qf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal Created pod/maas-api-key-cleanup-29894325-ll9qf Container created 16m Normal Started pod/maas-api-key-cleanup-29894325-ll9qf Container started 16m Normal SuccessfulDelete job/maas-api-key-cleanup-29894325 Deleted pod: maas-api-key-cleanup-29894325-ll9qf 16m Warning BackOff pod/maas-api-key-cleanup-29894325-ll9qf Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29894325-ll9qf_odh-ai-gateway-infra(43a94e39-5f1a-46ad-9ba4-1cff74c726b1) 16m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29894325 Job has reached the specified backoff limit 16m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29894325, condition: Failed 15m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-9998c 15m Normal Started pod/maas-api-revoke-sub-3d4156f1-9998c Container started 15m Normal Created pod/maas-api-revoke-sub-3d4156f1-9998c Container created 15m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-9998c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-9998c Add eth0 [10.133.0.208/23] from ovn-kubernetes 15m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 13m Normal SuccessfulCreate job/maas-api-revoke-sub-d576e68b Created pod: maas-api-revoke-sub-d576e68b-kpnrh 13m Normal AddedInterface pod/maas-api-revoke-sub-d576e68b-kpnrh Add eth0 [10.133.0.209/23] from ovn-kubernetes 13m Normal Pulled pod/maas-api-revoke-sub-d576e68b-kpnrh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal Created pod/maas-api-revoke-sub-d576e68b-kpnrh Container created 13m Normal Started pod/maas-api-revoke-sub-d576e68b-kpnrh Container started 13m Normal Completed job/maas-api-revoke-sub-d576e68b Job completed 13m Normal AddedInterface pod/maas-api-revoke-sub-d2bc93bc-j25nt Add eth0 [10.133.0.210/23] from ovn-kubernetes 13m Normal Pulled pod/maas-api-revoke-sub-d2bc93bc-j25nt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal SuccessfulCreate job/maas-api-revoke-sub-d2bc93bc Created pod: maas-api-revoke-sub-d2bc93bc-j25nt 13m Normal Created pod/maas-api-revoke-sub-d2bc93bc-j25nt Container created 13m Normal Started pod/maas-api-revoke-sub-d2bc93bc-j25nt Container started 13m Normal Completed job/maas-api-revoke-sub-d2bc93bc Job completed 12m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-c86709 Scaled up replica set maas-api-e2e-worker-single-main-c86709-7b86bc6785 from 0 to 1 12m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-c86709-7b86bc6785 Created pod: maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 12m Warning FailedMount pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-single-main-c86709-serving-cert" not found 12m Normal Pulling pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 12m Normal AddedInterface pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 Add eth0 [10.134.0.103/23] from ovn-kubernetes 12m Normal Created pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 Container created 12m Normal Started pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 Container started 12m Normal Pulled pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 942ms (942ms including waiting). Image size: 194581366 bytes. 11m Normal SuccessfulCreate job/maas-api-revoke-sub-337c8ec2 Created pod: maas-api-revoke-sub-337c8ec2-69q4k 11m Normal Created pod/maas-api-revoke-sub-337c8ec2-69q4k Container created 11m Normal Pulled pod/maas-api-revoke-sub-337c8ec2-69q4k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal Started pod/maas-api-revoke-sub-337c8ec2-69q4k Container started 11m Normal AddedInterface pod/maas-api-revoke-sub-337c8ec2-69q4k Add eth0 [10.133.0.213/23] from ovn-kubernetes 11m Normal Completed job/maas-api-revoke-sub-337c8ec2 Job completed 11m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-c86709-4z4ct Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-c86709 Created pod: maas-api-revoke-keys-e2e-worker-single-main-c86709-4z4ct 11m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-c86709-4z4ct Add eth0 [10.133.0.214/23] from ovn-kubernetes 11m Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-c86709-4z4ct Container created 11m Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-c86709-4z4ct Container started 11m Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-c86709 Job completed 11m Normal Killing pod/maas-api-e2e-worker-single-main-c86709-7b86bc6785-fzgq9 Stopping container maas-api 9m56s Normal SuccessfulCreate job/maas-api-revoke-sub-452b6d7b Created pod: maas-api-revoke-sub-452b6d7b-ttb8g 9m55s Normal Started pod/maas-api-revoke-sub-452b6d7b-ttb8g Container started 9m55s Normal Created pod/maas-api-revoke-sub-452b6d7b-ttb8g Container created 9m55s Normal Pulled pod/maas-api-revoke-sub-452b6d7b-ttb8g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 9m55s Normal AddedInterface pod/maas-api-revoke-sub-452b6d7b-ttb8g Add eth0 [10.133.0.215/23] from ovn-kubernetes 9m52s Normal Completed job/maas-api-revoke-sub-452b6d7b Job completed 9m31s Normal SuccessfulCreate job/maas-api-revoke-sub-3e31a506 Created pod: maas-api-revoke-sub-3e31a506-f7kfr 9m30s Normal Pulled pod/maas-api-revoke-sub-3e31a506-f7kfr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 9m30s Normal Started pod/maas-api-revoke-sub-3e31a506-f7kfr Container started 9m30s Normal Created pod/maas-api-revoke-sub-3e31a506-f7kfr Container created 9m30s Normal AddedInterface pod/maas-api-revoke-sub-3e31a506-f7kfr Add eth0 [10.133.0.216/23] from ovn-kubernetes 9m26s Normal Completed job/maas-api-revoke-sub-3e31a506 Job completed 9m1s Normal SuccessfulCreate job/maas-api-revoke-sub-831829d9 Created pod: maas-api-revoke-sub-831829d9-q8m8c 9m Normal Pulled pod/maas-api-revoke-sub-831829d9-q8m8c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 9m Normal Created pod/maas-api-revoke-sub-831829d9-q8m8c Container created 9m Normal AddedInterface pod/maas-api-revoke-sub-831829d9-q8m8c Add eth0 [10.133.0.217/23] from ovn-kubernetes 9m Normal Started pod/maas-api-revoke-sub-831829d9-q8m8c Container started 8m57s Normal Completed job/maas-api-revoke-sub-831829d9 Job completed 8m48s Normal SuccessfulCreate replicaset/maas-api-86c65979d7 Created pod: maas-api-86c65979d7-v94d5 8m48s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-86c65979d7 from 0 to 1 8m48s Normal SuccessfulCreate replicaset/maas-api-5bb6546495 Created pod: maas-api-5bb6546495-szj6q 8m48s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-5bb6546495 from 1 to 2 8m47s Normal Pulling pod/maas-api-86c65979d7-v94d5 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 8m47s Normal AddedInterface pod/maas-api-86c65979d7-v94d5 Add eth0 [10.134.0.105/23] from ovn-kubernetes 8m47s Normal AddedInterface pod/maas-api-5bb6546495-szj6q Add eth0 [10.132.0.111/23] from ovn-kubernetes 8m47s Normal Pulling pod/maas-api-5bb6546495-szj6q Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 8m46s Normal Created pod/maas-api-5bb6546495-szj6q Container created 8m46s Normal Pulled pod/maas-api-5bb6546495-szj6q Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.001s (1.001s including waiting). Image size: 194581366 bytes. 8m46s Normal Created pod/maas-api-86c65979d7-v94d5 Container created 8m46s Normal Started pod/maas-api-5bb6546495-szj6q Container started 8m46s Normal Pulled pod/maas-api-86c65979d7-v94d5 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 983ms (983ms including waiting). Image size: 194581366 bytes. 8m46s Normal Started pod/maas-api-86c65979d7-v94d5 Container started 8m39s Normal SuccessfulDelete replicaset/maas-api-5bb6546495 Deleted pod: maas-api-5bb6546495-c4r29 8m39s Normal SuccessfulCreate replicaset/maas-api-86c65979d7 Created pod: maas-api-86c65979d7-j5zvc 8m39s Normal AddedInterface pod/maas-api-86c65979d7-j5zvc Add eth0 [10.132.0.112/23] from ovn-kubernetes 8m39s Normal Pulling pod/maas-api-86c65979d7-j5zvc Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 8m39s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-86c65979d7 from 1 to 2 8m39s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-5bb6546495 from 2 to 1 8m39s Normal Killing pod/maas-api-5bb6546495-c4r29 Stopping container maas-api 8m38s Normal Pulled pod/maas-api-86c65979d7-j5zvc Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 954ms (954ms including waiting). Image size: 194581366 bytes. 8m38s Normal Created pod/maas-api-86c65979d7-j5zvc Container created 8m38s Normal Started pod/maas-api-86c65979d7-j5zvc Container started 8m35s Warning Unhealthy pod/maas-api-5bb6546495-c4r29 Readiness probe failed: Get "https://10.134.0.43:8443/health": context deadline exceeded 8m32s Normal ScalingReplicaSet deployment/maas-api-e2e-ait-e0efc115 Scaled up replica set maas-api-e2e-ait-e0efc115-559dc69989 from 0 to 1 8m32s Warning FailedMount pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-e0efc115-serving-cert" not found 8m32s Normal SuccessfulCreate replicaset/maas-api-e2e-ait-e0efc115-559dc69989 Created pod: maas-api-e2e-ait-e0efc115-559dc69989-jkw99 8m31s Normal AddedInterface pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 Add eth0 [10.134.0.106/23] from ovn-kubernetes 8m31s Normal SuccessfulDelete replicaset/maas-api-5bb6546495 Deleted pod: maas-api-5bb6546495-szj6q 8m31s Normal Pulling pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 8m31s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-5bb6546495 from 1 to 0 8m31s Normal Killing pod/maas-api-5bb6546495-szj6q Stopping container maas-api 8m30s Normal Started pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 Container started 8m30s Normal Pulled pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 833ms (833ms including waiting). Image size: 194581366 bytes. 8m30s Normal Created pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 Container created 8m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-e0efc115-z7f7l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-e0efc115-z7f7l Add eth0 [10.133.0.221/23] from ovn-kubernetes 8m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-e0efc115 Created pod: maas-api-revoke-keys-e2e-ait-e0efc115-z7f7l 7m59s Normal Started pod/maas-api-revoke-keys-e2e-ait-e0efc115-z7f7l Container started 7m59s Normal Created pod/maas-api-revoke-keys-e2e-ait-e0efc115-z7f7l Container created 7m56s Normal Completed job/maas-api-revoke-keys-e2e-ait-e0efc115 Job completed 7m41s Normal Killing pod/maas-api-e2e-ait-e0efc115-559dc69989-jkw99 Stopping container maas-api 7m22s Warning FailedMount pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-authcfg-http-9d4413-serving-cert" not found 7m22s Normal ScalingReplicaSet deployment/maas-api-e2e-authcfg-http-9d4413 Scaled up replica set maas-api-e2e-authcfg-http-9d4413-849844dbc7 from 0 to 1 7m22s Normal SuccessfulCreate replicaset/maas-api-e2e-authcfg-http-9d4413-849844dbc7 Created pod: maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp 7m21s Normal Pulling pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 7m21s Normal AddedInterface pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp Add eth0 [10.134.0.108/23] from ovn-kubernetes 7m19s Normal Started pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp Container started 7m19s Normal Pulled pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.116s (1.116s including waiting). Image size: 194581366 bytes. 7m19s Normal Created pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp Container created 5m23s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-authcfg-http-9d4413 Created pod: maas-api-revoke-keys-e2e-authcfg-http-9d4413-ghg8n 5m22s Normal AddedInterface pod/maas-api-revoke-keys-e2e-authcfg-http-9d4413-ghg8n Add eth0 [10.133.0.224/23] from ovn-kubernetes 5m22s Normal Pulled pod/maas-api-revoke-keys-e2e-authcfg-http-9d4413-ghg8n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 5m22s Normal Started pod/maas-api-revoke-keys-e2e-authcfg-http-9d4413-ghg8n Container started 5m22s Normal Created pod/maas-api-revoke-keys-e2e-authcfg-http-9d4413-ghg8n Container created 5m18s Normal Completed job/maas-api-revoke-keys-e2e-authcfg-http-9d4413 Job completed 5m2s Normal Killing pod/maas-api-e2e-authcfg-http-9d4413-849844dbc7-q2csp Stopping container maas-api 4m15s Normal AddedInterface pod/maas-api-revoke-sub-f03629db-zmtw8 Add eth0 [10.133.0.225/23] from ovn-kubernetes 4m15s Normal SuccessfulCreate job/maas-api-revoke-sub-f03629db Created pod: maas-api-revoke-sub-f03629db-zmtw8 4m15s Normal Pulled pod/maas-api-revoke-sub-f03629db-zmtw8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m14s Normal Started pod/maas-api-revoke-sub-f03629db-zmtw8 Container started 4m14s Normal Created pod/maas-api-revoke-sub-f03629db-zmtw8 Container created 4m11s Normal Completed job/maas-api-revoke-sub-f03629db Job completed 3m46s Normal Pulled pod/maas-api-revoke-sub-0165d7d2-kxl2q Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m46s Normal SuccessfulCreate job/maas-api-revoke-sub-0165d7d2 Created pod: maas-api-revoke-sub-0165d7d2-kxl2q 3m46s Normal AddedInterface pod/maas-api-revoke-sub-0165d7d2-kxl2q Add eth0 [10.133.0.226/23] from ovn-kubernetes 3m45s Normal Created pod/maas-api-revoke-sub-0165d7d2-kxl2q Container created 3m45s Normal Started pod/maas-api-revoke-sub-0165d7d2-kxl2q Container started 3m42s Normal Completed job/maas-api-revoke-sub-0165d7d2 Job completed 3m34s Normal SuccessfulCreate job/maas-api-revoke-sub-6b19338f Created pod: maas-api-revoke-sub-6b19338f-cbcn2 3m34s Normal AddedInterface pod/maas-api-revoke-sub-6b19338f-cbcn2 Add eth0 [10.133.0.227/23] from ovn-kubernetes 3m34s Normal Pulled pod/maas-api-revoke-sub-6b19338f-cbcn2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m33s Normal Started pod/maas-api-revoke-sub-6b19338f-cbcn2 Container started 3m33s Normal Created pod/maas-api-revoke-sub-6b19338f-cbcn2 Container created 3m30s Normal Completed job/maas-api-revoke-sub-6b19338f Job completed 81s Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29894340 81s Normal AddedInterface pod/maas-api-key-cleanup-29894340-b8ch4 Add eth0 [10.133.0.228/23] from ovn-kubernetes 81s Normal SuccessfulCreate job/maas-api-key-cleanup-29894340 Created pod: maas-api-key-cleanup-29894340-b8ch4 66s Normal Pulled pod/maas-api-key-cleanup-29894340-b8ch4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 65s Normal Created pod/maas-api-key-cleanup-29894340-b8ch4 Container created 65s Warning BackOff pod/maas-api-key-cleanup-29894340-b8ch4 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29894340-b8ch4_odh-ai-gateway-infra(915d667e-bd03-4720-938b-e3becd310270) 65s Normal Started pod/maas-api-key-cleanup-29894340-b8ch4 Container started 64s Normal SuccessfulDelete job/maas-api-key-cleanup-29894340 Deleted pod: maas-api-key-cleanup-29894340-b8ch4 63s Warning BackoffLimitExceeded job/maas-api-key-cleanup-29894340 Job has reached the specified backoff limit 63s Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29894340, condition: Failed 63s Normal SuccessfulDelete cronjob/maas-api-key-cleanup Deleted job maas-api-key-cleanup-29894295