=== events in odh-ai-gateway-infra (2026-11-03T22:10:28Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 22m Normal Scheduled pod/maas-api-revoke-sub-d33efaec-wrlsh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d33efaec-wrlsh to ip-10-0-131-253.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-d2bc93bc-zxcmq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-zxcmq to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-29895705-8ct6k Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29895705-8ct6k to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-b5108f5c-4g484 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b5108f5c-4g484 to ip-10-0-131-253.ec2.internal 10m Normal Scheduled pod/maas-api-key-cleanup-29895720-h7ffg Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg to ip-10-0-142-174.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-b4168ce3-2r5gl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b4168ce3-2r5gl to ip-10-0-131-253.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 to ip-10-0-137-212.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-b8811c72-z9vcj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b8811c72-z9vcj to ip-10-0-131-253.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-ae594979-rz5jq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-rz5jq to ip-10-0-131-253.ec2.internal 10m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-ba8353c4-hltps Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps to ip-10-0-142-174.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-ad385913-6fn9x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ad385913-6fn9x to ip-10-0-131-253.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-a4aef7d7-9dn9t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-9dn9t to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-a24d85e3-dkc78 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78 to ip-10-0-142-174.ec2.internal 32m Normal Scheduled pod/maas-api-7458978ff4-76djf Successfully assigned odh-ai-gateway-infra/maas-api-7458978ff4-76djf to ip-10-0-137-212.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-98a75a46-pjccr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-98a75a46-pjccr to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-92c4bdca-57zs6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-92c4bdca-57zs6 to ip-10-0-131-253.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb to ip-10-0-137-212.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-8f80204f-h952z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8f80204f-h952z to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-8f4b2ad8-crqp2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8f4b2ad8-crqp2 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-8cb49f77-sdqdt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8cb49f77-sdqdt to ip-10-0-131-253.ec2.internal 33m Normal Scheduled pod/postgres-7cdbf6dc44-hzchq Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-hzchq to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-8c21b054-zq8l4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8c21b054-zq8l4 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-885ff216-96mdg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-885ff216-96mdg to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz to ip-10-0-142-174.ec2.internal 7m46s Normal Scheduled pod/maas-api-cb9fbb88b-56xzv Successfully assigned odh-ai-gateway-infra/maas-api-cb9fbb88b-56xzv to ip-10-0-137-212.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm to ip-10-0-137-212.ec2.internal 13m Normal Scheduled pod/maas-api-revoke-sub-feed85b5-4kr5m Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-feed85b5-4kr5m to ip-10-0-131-253.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-1072f064-4dx59 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1072f064-4dx59 to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-13a99bb5-qcw99 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-13a99bb5-qcw99 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-14e905ad-l4255 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-14e905ad-l4255 to ip-10-0-131-253.ec2.internal 7m39s Normal Scheduled pod/maas-api-cb9fbb88b-jhpwk Successfully assigned odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk to ip-10-0-142-174.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-1561a7cd-gstql Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1561a7cd-gstql to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-1bdf0ab2-9zr4d Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1bdf0ab2-9zr4d to ip-10-0-131-253.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-1c40cee1-6qvvs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs to ip-10-0-142-174.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-f6a7e516-8xgfn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f6a7e516-8xgfn to ip-10-0-131-253.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-0b7e8edb-sx9cr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-sx9cr to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-04b00af2-rcdkw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-04b00af2-rcdkw to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-1d3f6fe1-flwcj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1d3f6fe1-flwcj to ip-10-0-131-253.ec2.internal 7m23s Normal Scheduled pod/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk to ip-10-0-137-212.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-046e1343-j4bcv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-j4bcv to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-21af73a2-nwll9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-21af73a2-nwll9 to ip-10-0-131-253.ec2.internal 4m14s Normal Scheduled pod/maas-api-revoke-sub-0165d7d2-rplcw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-rplcw to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-f317155d-jn47g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f317155d-jn47g to ip-10-0-131-253.ec2.internal 4m31s Normal Scheduled pod/maas-api-revoke-sub-f03629db-4qvl2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-4qvl2 to ip-10-0-131-253.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-ec843018-r8dn6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-r8dn6 to ip-10-0-131-253.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-e2fc9c5b-wdbm6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-wdbm6 to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-22b84cc7-lqdzv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-22b84cc7-lqdzv to ip-10-0-131-253.ec2.internal 6m47s Normal Scheduled pod/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs Successfully assigned odh-ai-gateway-infra/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs to ip-10-0-137-212.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w6-517149-zpddj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-517149-zpddj to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-288fc996-b9dm8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-288fc996-b9dm8 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w5-0a6da1-zxf2n Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-0a6da1-zxf2n to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-2afffa16-69bst Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2afffa16-69bst to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w4-05bc27-stcmm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-05bc27-stcmm to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-2b02f255-xhjvh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh to ip-10-0-142-174.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-e1e57fd5-fssrh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e1e57fd5-fssrh to ip-10-0-131-253.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-e10523d1-zns98 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e10523d1-zns98 to ip-10-0-131-253.ec2.internal 10m Normal Scheduled pod/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv to ip-10-0-137-212.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-da63b65f-bmlgh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-da63b65f-bmlgh to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w3-dd5620-jbxvx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-dd5620-jbxvx to ip-10-0-131-253.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-2e1f5b5f-t8brv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-t8brv to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-321bd940-2qf7b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-321bd940-2qf7b to ip-10-0-131-253.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-dsvpz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-dsvpz to ip-10-0-131-253.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-hnnbj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hnnbj to ip-10-0-131-253.ec2.internal 13m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-vsjfp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-vsjfp to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-d86cc3ff-m2nqb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d86cc3ff-m2nqb to ip-10-0-131-253.ec2.internal 14m Normal Scheduled pod/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb to ip-10-0-137-212.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-zztfl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-zztfl to ip-10-0-131-253.ec2.internal 7m46s Normal Scheduled pod/maas-api-7458978ff4-4djcb Successfully assigned odh-ai-gateway-infra/maas-api-7458978ff4-4djcb to ip-10-0-142-174.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv to ip-10-0-142-174.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-d3fba056-8l5lx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8l5lx to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-c787ced1-7tcjt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c787ced1-7tcjt to ip-10-0-131-253.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-c1e271a9-gsqkb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-gsqkb to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-c0a06a41-t9qfc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc to ip-10-0-142-174.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-bba538ea-cmsnx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx to ip-10-0-142-174.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r to ip-10-0-142-174.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-d576e68b-p7szb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-p7szb to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-b5290ae2-zmmpz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b5290ae2-zmmpz to ip-10-0-131-253.ec2.internal 8m29s Normal Scheduled pod/maas-api-revoke-sub-3e31a506-cgmkk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-cgmkk to ip-10-0-131-253.ec2.internal 8m51s Normal Scheduled pod/maas-api-revoke-sub-452b6d7b-nmg5l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-nmg5l to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-47c651af-j8f68 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-47c651af-j8f68 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w1-4eced5-qgjf9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-4eced5-qgjf9 to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-4c087459-ds7d6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4c087459-ds7d6 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc to ip-10-0-142-174.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-5498eaf4-5qtqp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5498eaf4-5qtqp to ip-10-0-131-253.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv to ip-10-0-137-212.ec2.internal 13m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-9f9b50-hxfxg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-9f9b50-hxfxg to ip-10-0-131-253.ec2.internal 7m59s Normal Scheduled pod/maas-api-revoke-sub-56327c97-z4lt4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-56327c97-z4lt4 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-0da877d2-7lqb2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0da877d2-7lqb2 to ip-10-0-131-253.ec2.internal 9m52s Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-3503c0-f29bs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-3503c0-f29bs to ip-10-0-131-253.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-5a29efb3-z9fmf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-z9fmf to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-5dceeffb-hwdxh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5dceeffb-hwdxh to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-87e8f73e-d77qr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-87e8f73e-d77qr to ip-10-0-131-253.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-85237e45-8lkg8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-8lkg8 to ip-10-0-131-253.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l to ip-10-0-137-212.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-5ecc6d17-8n5wn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5ecc6d17-8n5wn to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-6587b599-x8xn6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6587b599-x8xn6 to ip-10-0-131-253.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-65bf3fab-9bkz5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-65bf3fab-9bkz5 to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-68d768a4-q7pwm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-68d768a4-q7pwm to ip-10-0-131-253.ec2.internal 5m13s Normal Scheduled pod/maas-api-revoke-keys-e2e-authcfg-http-6a697e-g6m2t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-6a697e-g6m2t to ip-10-0-131-253.ec2.internal 4m3s Normal Scheduled pod/maas-api-revoke-sub-6b19338f-xkkmg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-xkkmg to ip-10-0-131-253.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-6b20ba06-ll5mt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b20ba06-ll5mt to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-6d838950-9fw62 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6d838950-9fw62 to ip-10-0-131-253.ec2.internal 7m10s Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 to ip-10-0-131-253.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-72df3e8f-827l8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8 to ip-10-0-142-174.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk to ip-10-0-142-174.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-79805ca9-6bztw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-6bztw to ip-10-0-131-253.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-79ae8406-bmg9w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79ae8406-bmg9w to ip-10-0-131-253.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x to ip-10-0-142-174.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-7fbcb306-qqffd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7fbcb306-qqffd to ip-10-0-131-253.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-81b36a7b-q86r4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-81b36a7b-q86r4 to ip-10-0-131-253.ec2.internal 32m Normal Scheduled pod/maas-api-6d669c7fcd-l6rj8 Successfully assigned odh-ai-gateway-infra/maas-api-6d669c7fcd-l6rj8 to ip-10-0-137-212.ec2.internal 25m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj to ip-10-0-142-174.ec2.internal 33m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 33m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-hzchq 33m Normal Pulling pod/postgres-7cdbf6dc44-hzchq Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 33m Normal AddedInterface pod/postgres-7cdbf6dc44-hzchq Add eth0 [10.132.0.48/23] from ovn-kubernetes 33m Normal Started pod/postgres-7cdbf6dc44-hzchq Container started 33m Normal Created pod/postgres-7cdbf6dc44-hzchq Container created 33m Normal Pulled pod/postgres-7cdbf6dc44-hzchq Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 4.947s (4.947s including waiting). Image size: 403732708 bytes. 32m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-6d669c7fcd from 0 to 1 32m Warning FailedCreate replicaset/maas-api-6d669c7fcd Error creating: pods "maas-api-6d669c7fcd-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 32m Normal SuccessfulCreate replicaset/maas-api-6d669c7fcd Created pod: maas-api-6d669c7fcd-l6rj8 32m Normal AddedInterface pod/maas-api-6d669c7fcd-l6rj8 Add eth0 [10.133.0.22/23] from ovn-kubernetes 32m Normal Pulling pod/maas-api-6d669c7fcd-l6rj8 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 32m Normal Started pod/maas-api-6d669c7fcd-l6rj8 Container started 32m Normal Pulled pod/maas-api-6d669c7fcd-l6rj8 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 2.147s (2.147s including waiting). Image size: 194581366 bytes. 32m Normal Created pod/maas-api-6d669c7fcd-l6rj8 Container created 32m Normal SuccessfulCreate replicaset/maas-api-7458978ff4 Created pod: maas-api-7458978ff4-76djf 32m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-7458978ff4 from 0 to 1 32m Normal Created pod/maas-api-7458978ff4-76djf Container created 32m Normal Started pod/maas-api-7458978ff4-76djf Container started 32m Normal Pulled pod/maas-api-7458978ff4-76djf Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 287ms (287ms including waiting). Image size: 194581366 bytes. 32m Normal Pulling pod/maas-api-7458978ff4-76djf Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 32m Normal AddedInterface pod/maas-api-7458978ff4-76djf Add eth0 [10.133.0.25/23] from ovn-kubernetes 32m Normal Killing pod/maas-api-6d669c7fcd-l6rj8 Stopping container maas-api 32m Normal SuccessfulDelete replicaset/maas-api-6d669c7fcd Deleted pod: maas-api-6d669c7fcd-l6rj8 32m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-6d669c7fcd from 1 to 0 28m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-4eced5 Scaled up replica set maas-api-e2e-worker-w1-4eced5-5ff87bf9bd from 0 to 1 28m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd Created pod: maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv 28m Normal Pulled pod/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 349ms (349ms including waiting). Image size: 194581366 bytes. 28m Normal AddedInterface pod/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv Add eth0 [10.133.0.41/23] from ovn-kubernetes 28m Normal Pulling pod/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 28m Normal Created pod/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv Container created 28m Normal Started pod/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv Container started 28m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-27fdf4-65947f86bd Created pod: maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l 28m Warning FailedMount pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w2-27fdf4-serving-cert" not found 28m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-27fdf4 Scaled up replica set maas-api-e2e-worker-w2-27fdf4-65947f86bd from 0 to 1 28m Normal Pulling pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 28m Normal AddedInterface pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Add eth0 [10.133.0.45/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 375ms (375ms including waiting). Image size: 194581366 bytes. 28m Normal AddedInterface pod/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb Add eth0 [10.133.0.47/23] from ovn-kubernetes 28m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-0a6da1-7cf4668747 Created pod: maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb 28m Normal Created pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Container created 28m Normal Started pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Container started 28m Normal Pulling pod/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 28m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-0a6da1 Scaled up replica set maas-api-e2e-worker-w5-0a6da1-7cf4668747 from 0 to 1 28m Normal Created pod/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb Container created 28m Normal Pulled pod/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 691ms (691ms including waiting). Image size: 194581366 bytes. 28m Normal Started pod/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb Container started 28m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-dd5620-7db4b48c99 Created pod: maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk 28m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-dd5620 Scaled up replica set maas-api-e2e-worker-w3-dd5620-7db4b48c99 from 0 to 1 28m Warning FailedMount pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w3-dd5620-serving-cert" not found 28m Normal AddedInterface pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Add eth0 [10.134.0.42/23] from ovn-kubernetes 28m Normal Pulling pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 28m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-05bc27-5d4f5cf998 Created pod: maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm 28m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-05bc27 Scaled up replica set maas-api-e2e-worker-w4-05bc27-5d4f5cf998 from 0 to 1 28m Warning FailedMount pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w4-05bc27-serving-cert" not found 28m Normal Pulled pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 2.248s (2.248s including waiting). Image size: 194581366 bytes. 28m Normal AddedInterface pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm Add eth0 [10.133.0.48/23] from ovn-kubernetes 28m Normal Pulling pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 28m Normal Created pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm Container created 28m Normal Pulled pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 364ms (364ms including waiting). Image size: 194581366 bytes. 28m Normal Started pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Container started 28m Normal Created pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Container created 28m Normal Started pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm Container started 28m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-517149 Scaled up replica set maas-api-e2e-worker-w6-517149-645559575d from 0 to 1 28m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-517149-645559575d Created pod: maas-api-e2e-worker-w6-517149-645559575d-f5tl4 28m Normal Pulling pod/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 28m Normal AddedInterface pod/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 Add eth0 [10.133.0.49/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 343ms (343ms including waiting). Image size: 194581366 bytes. 28m Normal Created pod/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 Container created 28m Normal Started pod/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 Container started 28m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-e246f9 Scaled up replica set maas-api-e2e-worker-w0-e246f9-d64d94985 from 0 to 1 28m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-e246f9-d64d94985 Created pod: maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r 28m Warning FailedMount pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w0-e246f9-serving-cert" not found 28m Normal Pulled pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 354ms (354ms including waiting). Image size: 194581366 bytes. 28m Normal Pulling pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 28m Normal AddedInterface pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r Add eth0 [10.134.0.45/23] from ovn-kubernetes 28m Normal Created pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r Container created 28m Normal Started pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r Container started 26m Normal SuccessfulCreate job/maas-api-revoke-sub-e1e57fd5 Created pod: maas-api-revoke-sub-e1e57fd5-fssrh 26m Normal AddedInterface pod/maas-api-revoke-sub-e1e57fd5-fssrh Add eth0 [10.132.0.78/23] from ovn-kubernetes 26m Normal Pulling pod/maas-api-revoke-sub-e1e57fd5-fssrh Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 26m Normal SuccessfulCreate job/maas-api-revoke-sub-79ae8406 Created pod: maas-api-revoke-sub-79ae8406-bmg9w 26m Normal AddedInterface pod/maas-api-revoke-sub-79ae8406-bmg9w Add eth0 [10.132.0.79/23] from ovn-kubernetes 26m Normal Pulling pod/maas-api-revoke-sub-79ae8406-bmg9w Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 26m Normal Pulled pod/maas-api-revoke-sub-79ae8406-bmg9w Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.336s (2.336s including waiting). Image size: 107195206 bytes. 26m Normal Created pod/maas-api-revoke-sub-79ae8406-bmg9w Container created 26m Normal Started pod/maas-api-revoke-sub-79ae8406-bmg9w Container started 26m Normal Completed job/maas-api-revoke-sub-79ae8406 Job completed 26m Normal AddedInterface pod/maas-api-revoke-sub-1d3f6fe1-flwcj Add eth0 [10.132.0.81/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-1d3f6fe1-flwcj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulCreate job/maas-api-revoke-sub-1d3f6fe1 Created pod: maas-api-revoke-sub-1d3f6fe1-flwcj 26m Normal Created pod/maas-api-revoke-sub-e1e57fd5-fssrh Container created 26m Normal Started pod/maas-api-revoke-sub-1d3f6fe1-flwcj Container started 26m Normal Created pod/maas-api-revoke-sub-1d3f6fe1-flwcj Container created 26m Normal Pulled pod/maas-api-revoke-sub-e1e57fd5-fssrh Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 13.238s (13.238s including waiting). Image size: 107195206 bytes. 26m Normal Started pod/maas-api-revoke-sub-e1e57fd5-fssrh Container started 26m Normal Completed job/maas-api-revoke-sub-e1e57fd5 Job completed 26m Normal Completed job/maas-api-revoke-sub-1d3f6fe1 Job completed 26m Normal AddedInterface pod/maas-api-revoke-sub-5498eaf4-5qtqp Add eth0 [10.132.0.82/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-5498eaf4-5qtqp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulCreate job/maas-api-revoke-sub-5498eaf4 Created pod: maas-api-revoke-sub-5498eaf4-5qtqp 26m Normal Started pod/maas-api-revoke-sub-5498eaf4-5qtqp Container started 26m Normal Created pod/maas-api-revoke-sub-5498eaf4-5qtqp Container created 26m Normal SuccessfulCreate job/maas-api-revoke-sub-288fc996 Created pod: maas-api-revoke-sub-288fc996-b9dm8 26m Normal AddedInterface pod/maas-api-revoke-sub-288fc996-b9dm8 Add eth0 [10.132.0.83/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-288fc996-b9dm8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-sub-288fc996-b9dm8 Container created 26m Normal Started pod/maas-api-revoke-sub-288fc996-b9dm8 Container started 26m Normal Completed job/maas-api-revoke-sub-5498eaf4 Job completed 26m Normal Completed job/maas-api-revoke-sub-288fc996 Job completed 26m Normal SuccessfulCreate job/maas-api-revoke-sub-d86cc3ff Created pod: maas-api-revoke-sub-d86cc3ff-m2nqb 26m Normal Started pod/maas-api-revoke-sub-d86cc3ff-m2nqb Container started 26m Normal Pulled pod/maas-api-revoke-sub-f317155d-jn47g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Pulled pod/maas-api-revoke-sub-d86cc3ff-m2nqb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-sub-d86cc3ff-m2nqb Container created 26m Normal AddedInterface pod/maas-api-revoke-sub-d86cc3ff-m2nqb Add eth0 [10.132.0.84/23] from ovn-kubernetes 26m Normal SuccessfulCreate job/maas-api-revoke-sub-f317155d Created pod: maas-api-revoke-sub-f317155d-jn47g 26m Normal AddedInterface pod/maas-api-revoke-sub-f317155d-jn47g Add eth0 [10.132.0.85/23] from ovn-kubernetes 26m Normal Started pod/maas-api-revoke-sub-f317155d-jn47g Container started 26m Normal Created pod/maas-api-revoke-sub-f317155d-jn47g Container created 26m Normal SuccessfulCreate job/maas-api-revoke-sub-ad385913 Created pod: maas-api-revoke-sub-ad385913-6fn9x 26m Normal AddedInterface pod/maas-api-revoke-sub-ad385913-6fn9x Add eth0 [10.132.0.86/23] from ovn-kubernetes 26m Normal Started pod/maas-api-revoke-sub-ad385913-6fn9x Container started 26m Normal Created pod/maas-api-revoke-sub-ad385913-6fn9x Container created 26m Normal Pulled pod/maas-api-revoke-sub-ad385913-6fn9x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Completed job/maas-api-revoke-sub-d86cc3ff Job completed 26m Normal SuccessfulCreate job/maas-api-revoke-sub-47c651af Created pod: maas-api-revoke-sub-47c651af-j8f68 26m Normal Pulled pod/maas-api-revoke-sub-47c651af-j8f68 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal AddedInterface pod/maas-api-revoke-sub-47c651af-j8f68 Add eth0 [10.132.0.87/23] from ovn-kubernetes 26m Normal Completed job/maas-api-revoke-sub-f317155d Job completed 26m Normal Started pod/maas-api-revoke-sub-47c651af-j8f68 Container started 26m Normal Created pod/maas-api-revoke-sub-47c651af-j8f68 Container created 26m Normal SuccessfulCreate job/maas-api-revoke-sub-b4168ce3 Created pod: maas-api-revoke-sub-b4168ce3-2r5gl 26m Normal Pulled pod/maas-api-revoke-sub-b4168ce3-2r5gl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulCreate job/maas-api-revoke-sub-2afffa16 Created pod: maas-api-revoke-sub-2afffa16-69bst 26m Normal AddedInterface pod/maas-api-revoke-sub-b4168ce3-2r5gl Add eth0 [10.132.0.88/23] from ovn-kubernetes 26m Normal Started pod/maas-api-revoke-sub-b4168ce3-2r5gl Container started 26m Normal Created pod/maas-api-revoke-sub-b4168ce3-2r5gl Container created 26m Normal AddedInterface pod/maas-api-revoke-sub-2afffa16-69bst Add eth0 [10.132.0.89/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-2afffa16-69bst Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Completed job/maas-api-revoke-sub-ad385913 Job completed 26m Normal SuccessfulCreate job/maas-api-revoke-sub-4c087459 Created pod: maas-api-revoke-sub-4c087459-ds7d6 26m Normal Started pod/maas-api-revoke-sub-2afffa16-69bst Container started 26m Normal Created pod/maas-api-revoke-sub-2afffa16-69bst Container created 26m Normal AddedInterface pod/maas-api-revoke-sub-4c087459-ds7d6 Add eth0 [10.132.0.90/23] from ovn-kubernetes 26m Normal Started pod/maas-api-revoke-sub-4c087459-ds7d6 Container started 26m Normal Pulled pod/maas-api-revoke-sub-4c087459-ds7d6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-sub-4c087459-ds7d6 Container created 26m Normal Completed job/maas-api-revoke-sub-47c651af Job completed 26m Normal Completed job/maas-api-revoke-sub-b4168ce3 Job completed 26m Normal Completed job/maas-api-revoke-sub-2afffa16 Job completed 25m Normal SuccessfulCreate job/maas-api-revoke-sub-87e8f73e Created pod: maas-api-revoke-sub-87e8f73e-d77qr 25m Normal Completed job/maas-api-revoke-sub-4c087459 Job completed 25m Normal Pulled pod/maas-api-revoke-sub-87e8f73e-d77qr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal AddedInterface pod/maas-api-revoke-sub-87e8f73e-d77qr Add eth0 [10.132.0.91/23] from ovn-kubernetes 25m Normal Created pod/maas-api-revoke-sub-87e8f73e-d77qr Container created 25m Normal Started pod/maas-api-revoke-sub-87e8f73e-d77qr Container started 25m Normal Pulled pod/maas-api-revoke-sub-04b00af2-rcdkw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal SuccessfulCreate job/maas-api-revoke-sub-04b00af2 Created pod: maas-api-revoke-sub-04b00af2-rcdkw 25m Normal Started pod/maas-api-revoke-sub-04b00af2-rcdkw Container started 25m Normal AddedInterface pod/maas-api-revoke-sub-04b00af2-rcdkw Add eth0 [10.132.0.92/23] from ovn-kubernetes 25m Normal SuccessfulCreate job/maas-api-revoke-sub-22b84cc7 Created pod: maas-api-revoke-sub-22b84cc7-lqdzv 25m Normal Created pod/maas-api-revoke-sub-04b00af2-rcdkw Container created 25m Normal SuccessfulCreate job/maas-api-revoke-sub-f6a7e516 Created pod: maas-api-revoke-sub-f6a7e516-8xgfn 25m Normal Started pod/maas-api-revoke-sub-22b84cc7-lqdzv Container started 25m Normal SuccessfulCreate job/maas-api-revoke-sub-ba8353c4 Created pod: maas-api-revoke-sub-ba8353c4-hltps 25m Normal Created pod/maas-api-revoke-sub-22b84cc7-lqdzv Container created 25m Normal Pulled pod/maas-api-revoke-sub-22b84cc7-lqdzv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal AddedInterface pod/maas-api-revoke-sub-22b84cc7-lqdzv Add eth0 [10.132.0.93/23] from ovn-kubernetes 25m Normal Pulling pod/maas-api-revoke-sub-ba8353c4-hltps Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 25m Normal AddedInterface pod/maas-api-revoke-sub-f6a7e516-8xgfn Add eth0 [10.132.0.94/23] from ovn-kubernetes 25m Normal Completed job/maas-api-revoke-sub-87e8f73e Job completed 25m Normal Started pod/maas-api-revoke-sub-f6a7e516-8xgfn Container started 25m Normal Created pod/maas-api-revoke-sub-f6a7e516-8xgfn Container created 25m Normal AddedInterface pod/maas-api-revoke-sub-ba8353c4-hltps Add eth0 [10.134.0.56/23] from ovn-kubernetes 25m Normal Pulled pod/maas-api-revoke-sub-f6a7e516-8xgfn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Pulled pod/maas-api-revoke-sub-ba8353c4-hltps Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.213s (2.213s including waiting). Image size: 107195206 bytes. 25m Normal Completed job/maas-api-revoke-sub-04b00af2 Job completed 25m Normal Completed job/maas-api-revoke-sub-22b84cc7 Job completed 25m Normal Started pod/maas-api-revoke-sub-ba8353c4-hltps Container started 25m Normal SuccessfulCreate job/maas-api-revoke-sub-8f4b2ad8 Created pod: maas-api-revoke-sub-8f4b2ad8-crqp2 25m Normal Created pod/maas-api-revoke-sub-ba8353c4-hltps Container created 25m Normal AddedInterface pod/maas-api-revoke-sub-8f4b2ad8-crqp2 Add eth0 [10.132.0.95/23] from ovn-kubernetes 25m Normal Pulled pod/maas-api-revoke-sub-8f4b2ad8-crqp2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Created pod/maas-api-revoke-sub-8f4b2ad8-crqp2 Container created 25m Normal Started pod/maas-api-revoke-sub-8f4b2ad8-crqp2 Container started 25m Normal Completed job/maas-api-revoke-sub-f6a7e516 Job completed 25m Normal Completed job/maas-api-revoke-sub-ba8353c4 Job completed 25m Normal Completed job/maas-api-revoke-sub-8f4b2ad8 Job completed 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-517149 Created job maas-api-key-cleanup-e2e-worker-w6-517149-29895705 25m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705 Created pod: maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-4eced5 Created job maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705 25m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz Add eth0 [10.134.0.61/23] from ovn-kubernetes 25m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 Add eth0 [10.132.0.101/23] from ovn-kubernetes 25m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x Add eth0 [10.134.0.59/23] from ovn-kubernetes 25m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs Add eth0 [10.132.0.97/23] from ovn-kubernetes 25m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705 Created pod: maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj 25m Normal SuccessfulCreate job/maas-api-key-cleanup-29895705 Created pod: maas-api-key-cleanup-29895705-8ct6k 25m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705 Created pod: maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-dd5620 Created job maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705 25m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 Add eth0 [10.132.0.98/23] from ovn-kubernetes 25m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705 Created pod: maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-e246f9 Created job maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705 25m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-517149-29895705 Created pod: maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-05bc27 Created job maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705 25m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705 Created pod: maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl 25m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj Add eth0 [10.134.0.60/23] from ovn-kubernetes 25m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705 Created pod: maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 25m Normal AddedInterface pod/maas-api-key-cleanup-29895705-8ct6k Add eth0 [10.132.0.99/23] from ovn-kubernetes 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-27fdf4 Created job maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-0a6da1 Created job maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705 25m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29895705 25m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl Add eth0 [10.132.0.100/23] from ovn-kubernetes 25m Normal SuccessfulCreate job/maas-api-revoke-sub-21af73a2 Created pod: maas-api-revoke-sub-21af73a2-nwll9 25m Normal AddedInterface pod/maas-api-revoke-sub-21af73a2-nwll9 Add eth0 [10.132.0.103/23] from ovn-kubernetes 25m Normal Pulled pod/maas-api-revoke-sub-21af73a2-nwll9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Started pod/maas-api-revoke-sub-21af73a2-nwll9 Container started 25m Normal Created pod/maas-api-revoke-sub-21af73a2-nwll9 Container created 25m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229_odh-ai-gateway-infra(832c2242-e330-4541-961b-4acde0fbd38f) 25m Normal Completed job/maas-api-revoke-sub-21af73a2 Job completed 25m Normal SuccessfulCreate job/maas-api-revoke-sub-6d838950 Created pod: maas-api-revoke-sub-6d838950-9fw62 25m Normal AddedInterface pod/maas-api-revoke-sub-6d838950-9fw62 Add eth0 [10.132.0.108/23] from ovn-kubernetes 25m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 Container created 25m Normal Pulled pod/maas-api-revoke-sub-6d838950-9fw62 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Started pod/maas-api-revoke-sub-6d838950-9fw62 Container started 25m Normal Created pod/maas-api-revoke-sub-6d838950-9fw62 Container created 25m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 Container started 25m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Pulled pod/maas-api-key-cleanup-29895705-8ct6k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705-4t229 25m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz Container created 25m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj Container created 25m Normal Created pod/maas-api-key-cleanup-29895705-8ct6k Container created 25m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x Container started 25m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x Container created 25m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs Container started 25m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl Container started 25m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs Container created 25m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz Container started 25m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl Container created 25m Normal Started pod/maas-api-key-cleanup-29895705-8ct6k Container started 25m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj Container started 25m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj_odh-ai-gateway-infra(59fa144b-e7fd-4bfc-aba8-3f3112adc882) 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705 Job has reached the specified backoff limit 25m Warning BackOff pod/maas-api-key-cleanup-29895705-8ct6k Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29895705-8ct6k_odh-ai-gateway-infra(64e997e7-9d8b-469b-ac1f-743fa96f7e1f) 25m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz 25m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj 25m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 Container started 25m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 Container created 25m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs_odh-ai-gateway-infra(c2b4096e-7ea0-4377-a8a0-67c3c27d0036) 25m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz_odh-ai-gateway-infra(a3a5cd1d-6c78-477d-8ce7-a87f8b092505) 25m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl_odh-ai-gateway-infra(947188bc-8b80-416c-b31a-c3ed370dd012) 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-0a6da1 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-0a6da1-29895705, condition: Failed 25m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x_odh-ai-gateway-infra(16b4a2a7-3e2c-44fa-8ae9-57537401e340) 25m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-517149-29895705 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x 25m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705 Deleted pod: maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705-68svl 25m Normal Completed job/maas-api-revoke-sub-6d838950 Job completed 25m Normal SuccessfulDelete job/maas-api-key-cleanup-29895705 Deleted pod: maas-api-key-cleanup-29895705-8ct6k 25m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705-sqrqs 25m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7_odh-ai-gateway-infra(f43eed4a-92c9-4074-936f-b48712db3dfc) 25m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705-mb6d7 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705 Job has reached the specified backoff limit 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29895705, condition: Failed 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-dd5620 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705, condition: Failed 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705 Job has reached the specified backoff limit 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705 Job has reached the specified backoff limit 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-27fdf4 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-27fdf4-29895705, condition: Failed 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29895705 Job has reached the specified backoff limit 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w0-e246f9 Saw completed job: maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705, condition: Failed 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-05bc27 Saw completed job: maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705, condition: Failed 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-517149-29895705 Job has reached the specified backoff limit 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w0-e246f9-29895705 Job has reached the specified backoff limit 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-517149 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-517149-29895705, condition: Failed 25m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705 Job has reached the specified backoff limit 25m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-4eced5 Saw completed job: maas-api-key-cleanup-e2e-worker-w1-4eced5-29895705, condition: Failed 24m Normal AddedInterface pod/maas-api-revoke-sub-6b20ba06-ll5mt Add eth0 [10.132.0.111/23] from ovn-kubernetes 24m Normal SuccessfulCreate job/maas-api-revoke-sub-6b20ba06 Created pod: maas-api-revoke-sub-6b20ba06-ll5mt 24m Normal Pulled pod/maas-api-revoke-sub-6b20ba06-ll5mt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal Started pod/maas-api-revoke-sub-6b20ba06-ll5mt Container started 24m Normal Created pod/maas-api-revoke-sub-6b20ba06-ll5mt Container created 24m Normal Completed job/maas-api-revoke-sub-6b20ba06 Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-1072f064 Created pod: maas-api-revoke-sub-1072f064-4dx59 24m Normal AddedInterface pod/maas-api-revoke-sub-1072f064-4dx59 Add eth0 [10.132.0.116/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-sub-1072f064-4dx59 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal Started pod/maas-api-revoke-sub-1072f064-4dx59 Container started 24m Normal Created pod/maas-api-revoke-sub-1072f064-4dx59 Container created 24m Normal SuccessfulCreate job/maas-api-revoke-sub-e10523d1 Created pod: maas-api-revoke-sub-e10523d1-zns98 24m Normal Pulled pod/maas-api-revoke-sub-e10523d1-zns98 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal AddedInterface pod/maas-api-revoke-sub-e10523d1-zns98 Add eth0 [10.132.0.117/23] from ovn-kubernetes 24m Normal Completed job/maas-api-revoke-sub-1072f064 Job completed 24m Normal Started pod/maas-api-revoke-sub-e10523d1-zns98 Container started 24m Normal Created pod/maas-api-revoke-sub-e10523d1-zns98 Container created 24m Normal Completed job/maas-api-revoke-sub-e10523d1 Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-b8811c72 Created pod: maas-api-revoke-sub-b8811c72-z9vcj 23m Normal AddedInterface pod/maas-api-revoke-sub-b8811c72-z9vcj Add eth0 [10.132.0.118/23] from ovn-kubernetes 23m Normal Started pod/maas-api-revoke-sub-b8811c72-z9vcj Container started 23m Normal Pulled pod/maas-api-revoke-sub-b8811c72-z9vcj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Created pod/maas-api-revoke-sub-b8811c72-z9vcj Container created 23m Normal Completed job/maas-api-revoke-sub-b8811c72 Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-da63b65f Created pod: maas-api-revoke-sub-da63b65f-bmlgh 23m Normal AddedInterface pod/maas-api-revoke-sub-da63b65f-bmlgh Add eth0 [10.132.0.121/23] from ovn-kubernetes 23m Normal Started pod/maas-api-revoke-sub-da63b65f-bmlgh Container started 23m Normal Created pod/maas-api-revoke-sub-da63b65f-bmlgh Container created 23m Normal Pulled pod/maas-api-revoke-sub-da63b65f-bmlgh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Completed job/maas-api-revoke-sub-da63b65f Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-5dceeffb Created pod: maas-api-revoke-sub-5dceeffb-hwdxh 23m Normal SuccessfulCreate job/maas-api-revoke-sub-13a99bb5 Created pod: maas-api-revoke-sub-13a99bb5-qcw99 23m Normal AddedInterface pod/maas-api-revoke-sub-5dceeffb-hwdxh Add eth0 [10.132.0.126/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-5dceeffb-hwdxh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-sub-13a99bb5-qcw99 Add eth0 [10.132.0.127/23] from ovn-kubernetes 23m Normal Created pod/maas-api-revoke-sub-5dceeffb-hwdxh Container created 23m Normal Started pod/maas-api-revoke-sub-5dceeffb-hwdxh Container started 23m Normal Pulled pod/maas-api-revoke-sub-13a99bb5-qcw99 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Started pod/maas-api-revoke-sub-13a99bb5-qcw99 Container started 23m Normal Created pod/maas-api-revoke-sub-13a99bb5-qcw99 Container created 23m Normal AddedInterface pod/maas-api-revoke-sub-2b02f255-xhjvh Add eth0 [10.134.0.75/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-2b02f255-xhjvh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal SuccessfulCreate job/maas-api-revoke-sub-2b02f255 Created pod: maas-api-revoke-sub-2b02f255-xhjvh 23m Normal Completed job/maas-api-revoke-sub-5dceeffb Job completed 23m Normal Created pod/maas-api-revoke-sub-2b02f255-xhjvh Container created 23m Normal Started pod/maas-api-revoke-sub-2b02f255-xhjvh Container started 23m Normal Completed job/maas-api-revoke-sub-13a99bb5 Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-81b36a7b Created pod: maas-api-revoke-sub-81b36a7b-q86r4 23m Normal Completed job/maas-api-revoke-sub-2b02f255 Job completed 23m Normal AddedInterface pod/maas-api-revoke-sub-81b36a7b-q86r4 Add eth0 [10.132.0.129/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-81b36a7b-q86r4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Started pod/maas-api-revoke-sub-81b36a7b-q86r4 Container started 23m Normal Created pod/maas-api-revoke-sub-81b36a7b-q86r4 Container created 23m Normal SuccessfulCreate job/maas-api-revoke-sub-7fbcb306 Created pod: maas-api-revoke-sub-7fbcb306-qqffd 23m Normal AddedInterface pod/maas-api-revoke-sub-7fbcb306-qqffd Add eth0 [10.132.0.130/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-7fbcb306-qqffd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Started pod/maas-api-revoke-sub-7fbcb306-qqffd Container started 23m Normal Created pod/maas-api-revoke-sub-7fbcb306-qqffd Container created 23m Normal Completed job/maas-api-revoke-sub-81b36a7b Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-68d768a4 Created pod: maas-api-revoke-sub-68d768a4-q7pwm 23m Normal AddedInterface pod/maas-api-revoke-sub-68d768a4-q7pwm Add eth0 [10.132.0.131/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-68d768a4-q7pwm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Created pod/maas-api-revoke-sub-68d768a4-q7pwm Container created 23m Normal Started pod/maas-api-revoke-sub-68d768a4-q7pwm Container started 23m Normal Completed job/maas-api-revoke-sub-7fbcb306 Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-b5108f5c Created pod: maas-api-revoke-sub-b5108f5c-4g484 23m Normal Completed job/maas-api-revoke-sub-68d768a4 Job completed 23m Normal AddedInterface pod/maas-api-revoke-sub-b5108f5c-4g484 Add eth0 [10.132.0.132/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-b5108f5c-4g484 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w3-dd5620 Created pod: maas-api-revoke-keys-e2e-worker-w3-dd5620-jbxvx 23m Normal Started pod/maas-api-revoke-sub-b5108f5c-4g484 Container started 23m Normal Created pod/maas-api-revoke-sub-b5108f5c-4g484 Container created 23m Normal Created pod/maas-api-revoke-keys-e2e-worker-w3-dd5620-jbxvx Container created 23m Normal Started pod/maas-api-revoke-keys-e2e-worker-w3-dd5620-jbxvx Container started 23m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w3-dd5620-jbxvx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w3-dd5620-jbxvx Add eth0 [10.132.0.133/23] from ovn-kubernetes 23m Normal SuccessfulCreate job/maas-api-revoke-sub-98a75a46 Created pod: maas-api-revoke-sub-98a75a46-pjccr 23m Normal Pulled pod/maas-api-revoke-sub-98a75a46-pjccr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-sub-98a75a46-pjccr Add eth0 [10.132.0.134/23] from ovn-kubernetes 23m Normal Created pod/maas-api-revoke-sub-98a75a46-pjccr Container created 23m Normal Started pod/maas-api-revoke-sub-98a75a46-pjccr Container started 23m Normal Completed job/maas-api-revoke-sub-b5108f5c Job completed 23m Normal Completed job/maas-api-revoke-keys-e2e-worker-w3-dd5620 Job completed 23m Normal Completed job/maas-api-revoke-sub-98a75a46 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-72df3e8f Created pod: maas-api-revoke-sub-72df3e8f-827l8 22m Normal SuccessfulCreate job/maas-api-revoke-sub-92c4bdca Created pod: maas-api-revoke-sub-92c4bdca-57zs6 22m Normal SuccessfulCreate job/maas-api-revoke-sub-d33efaec Created pod: maas-api-revoke-sub-d33efaec-wrlsh 22m Normal SuccessfulCreate job/maas-api-revoke-sub-0da877d2 Created pod: maas-api-revoke-sub-0da877d2-7lqb2 22m Normal AddedInterface pod/maas-api-revoke-sub-0da877d2-7lqb2 Add eth0 [10.132.0.137/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-72df3e8f-827l8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-sub-72df3e8f-827l8 Add eth0 [10.134.0.79/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-0da877d2-7lqb2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Started pod/maas-api-revoke-sub-92c4bdca-57zs6 Container started 22m Normal Pulled pod/maas-api-revoke-sub-92c4bdca-57zs6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Started pod/maas-api-revoke-sub-72df3e8f-827l8 Container started 22m Normal Created pod/maas-api-revoke-sub-0da877d2-7lqb2 Container created 22m Normal Started pod/maas-api-revoke-sub-0da877d2-7lqb2 Container started 22m Normal Created pod/maas-api-revoke-sub-72df3e8f-827l8 Container created 22m Normal Pulled pod/maas-api-revoke-sub-d33efaec-wrlsh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-sub-92c4bdca-57zs6 Add eth0 [10.132.0.139/23] from ovn-kubernetes 22m Normal AddedInterface pod/maas-api-revoke-sub-d33efaec-wrlsh Add eth0 [10.132.0.138/23] from ovn-kubernetes 22m Normal Created pod/maas-api-revoke-sub-92c4bdca-57zs6 Container created 22m Normal Created pod/maas-api-revoke-sub-d33efaec-wrlsh Container created 22m Normal SuccessfulCreate job/maas-api-revoke-sub-321bd940 Created pod: maas-api-revoke-sub-321bd940-2qf7b 22m Normal Started pod/maas-api-revoke-sub-d33efaec-wrlsh Container started 22m Normal AddedInterface pod/maas-api-revoke-sub-321bd940-2qf7b Add eth0 [10.132.0.140/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-321bd940-2qf7b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-321bd940-2qf7b Container created 22m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w0-e246f9 Created pod: maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc 22m Normal Completed job/maas-api-revoke-sub-72df3e8f Job completed 22m Normal Started pod/maas-api-revoke-sub-321bd940-2qf7b Container started 22m Normal Started pod/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc Container started 22m Normal Completed job/maas-api-revoke-sub-d33efaec Job completed 22m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc Add eth0 [10.134.0.80/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc Container created 22m Normal Completed job/maas-api-revoke-sub-92c4bdca Job completed 22m Normal Completed job/maas-api-revoke-sub-0da877d2 Job completed 22m Normal Completed job/maas-api-revoke-sub-321bd940 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-14e905ad Created pod: maas-api-revoke-sub-14e905ad-l4255 22m Normal AddedInterface pod/maas-api-revoke-sub-14e905ad-l4255 Add eth0 [10.132.0.141/23] from ovn-kubernetes 22m Normal Completed job/maas-api-revoke-keys-e2e-worker-w0-e246f9 Job completed 22m Normal Created pod/maas-api-revoke-sub-14e905ad-l4255 Container created 22m Normal Started pod/maas-api-revoke-sub-14e905ad-l4255 Container started 22m Normal Pulled pod/maas-api-revoke-sub-14e905ad-l4255 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Completed job/maas-api-revoke-sub-14e905ad Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w5-0a6da1 Created pod: maas-api-revoke-keys-e2e-worker-w5-0a6da1-zxf2n 22m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w5-0a6da1-zxf2n Add eth0 [10.132.0.142/23] from ovn-kubernetes 22m Normal Created pod/maas-api-revoke-keys-e2e-worker-w5-0a6da1-zxf2n Container created 22m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w5-0a6da1-zxf2n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w1-4eced5 Created pod: maas-api-revoke-keys-e2e-worker-w1-4eced5-qgjf9 22m Normal Started pod/maas-api-revoke-keys-e2e-worker-w5-0a6da1-zxf2n Container started 22m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w1-4eced5-qgjf9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w1-4eced5-qgjf9 Add eth0 [10.132.0.143/23] from ovn-kubernetes 22m Normal SuccessfulCreate job/maas-api-revoke-sub-8cb49f77 Created pod: maas-api-revoke-sub-8cb49f77-sdqdt 22m Normal Started pod/maas-api-revoke-keys-e2e-worker-w1-4eced5-qgjf9 Container started 22m Normal Created pod/maas-api-revoke-keys-e2e-worker-w1-4eced5-qgjf9 Container created 22m Normal Created pod/maas-api-revoke-sub-8cb49f77-sdqdt Container created 22m Normal Started pod/maas-api-revoke-sub-8cb49f77-sdqdt Container started 22m Normal AddedInterface pod/maas-api-revoke-sub-8cb49f77-sdqdt Add eth0 [10.132.0.144/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-8cb49f77-sdqdt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Completed job/maas-api-revoke-keys-e2e-worker-w5-0a6da1 Job completed 22m Warning Unhealthy pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Readiness probe failed: Get "https://10.134.0.42:8443/health": dial tcp 10.134.0.42:8443: connect: connection refused 22m Normal Killing pod/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk Stopping container maas-api 22m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w4-05bc27 Created pod: maas-api-revoke-keys-e2e-worker-w4-05bc27-stcmm 22m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w4-05bc27-stcmm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Started pod/maas-api-revoke-keys-e2e-worker-w4-05bc27-stcmm Container started 22m Normal Created pod/maas-api-revoke-keys-e2e-worker-w4-05bc27-stcmm Container created 22m Normal Completed job/maas-api-revoke-keys-e2e-worker-w1-4eced5 Job completed 22m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w4-05bc27-stcmm Add eth0 [10.132.0.145/23] from ovn-kubernetes 22m Normal Completed job/maas-api-revoke-sub-8cb49f77 Job completed 22m Normal Completed job/maas-api-revoke-keys-e2e-worker-w4-05bc27 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-b5290ae2 Created pod: maas-api-revoke-sub-b5290ae2-zmmpz 22m Normal SuccessfulCreate job/maas-api-revoke-sub-a24d85e3 Created pod: maas-api-revoke-sub-a24d85e3-dkc78 22m Normal SuccessfulCreate job/maas-api-revoke-sub-6587b599 Created pod: maas-api-revoke-sub-6587b599-x8xn6 22m Normal SuccessfulCreate job/maas-api-revoke-sub-1bdf0ab2 Created pod: maas-api-revoke-sub-1bdf0ab2-9zr4d 22m Normal AddedInterface pod/maas-api-revoke-sub-a24d85e3-dkc78 Add eth0 [10.134.0.81/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-a24d85e3-dkc78 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Started pod/maas-api-revoke-sub-a24d85e3-dkc78 Container started 22m Normal Created pod/maas-api-revoke-sub-a24d85e3-dkc78 Container created 22m Normal AddedInterface pod/maas-api-revoke-sub-6587b599-x8xn6 Add eth0 [10.132.0.147/23] from ovn-kubernetes 22m Normal AddedInterface pod/maas-api-revoke-sub-b5290ae2-zmmpz Add eth0 [10.132.0.146/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-b5290ae2-zmmpz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Completed job/maas-api-revoke-sub-a24d85e3 Job completed 22m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv Add eth0 [10.134.0.82/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w2-27fdf4 Created pod: maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv 22m Normal Started pod/maas-api-revoke-sub-1bdf0ab2-9zr4d Container started 22m Normal Started pod/maas-api-revoke-sub-b5290ae2-zmmpz Container started 22m Normal AddedInterface pod/maas-api-revoke-sub-1bdf0ab2-9zr4d Add eth0 [10.132.0.148/23] from ovn-kubernetes 22m Normal AddedInterface pod/maas-api-revoke-sub-c0a06a41-t9qfc Add eth0 [10.134.0.83/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-c0a06a41-t9qfc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-6587b599-x8xn6 Container created 22m Normal Pulled pod/maas-api-revoke-sub-6587b599-x8xn6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Pulled pod/maas-api-revoke-sub-1bdf0ab2-9zr4d Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-1bdf0ab2-9zr4d Container created 22m Normal Started pod/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv Container started 22m Normal Created pod/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv Container created 22m Normal Created pod/maas-api-revoke-sub-b5290ae2-zmmpz Container created 22m Normal SuccessfulCreate job/maas-api-revoke-sub-c0a06a41 Created pod: maas-api-revoke-sub-c0a06a41-t9qfc 22m Normal Started pod/maas-api-revoke-sub-6587b599-x8xn6 Container started 22m Normal Created pod/maas-api-revoke-sub-c0a06a41-t9qfc Container created 22m Normal Started pod/maas-api-revoke-sub-c0a06a41-t9qfc Container started 22m Normal SuccessfulCreate job/maas-api-revoke-sub-bba538ea Created pod: maas-api-revoke-sub-bba538ea-cmsnx 22m Normal Completed job/maas-api-revoke-keys-e2e-worker-w2-27fdf4 Job completed 22m Normal AddedInterface pod/maas-api-revoke-sub-1561a7cd-gstql Add eth0 [10.132.0.149/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-1561a7cd-gstql Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal SuccessfulCreate job/maas-api-revoke-sub-1561a7cd Created pod: maas-api-revoke-sub-1561a7cd-gstql 22m Normal Pulled pod/maas-api-revoke-sub-bba538ea-cmsnx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-sub-bba538ea-cmsnx Add eth0 [10.134.0.84/23] from ovn-kubernetes 22m Normal Started pod/maas-api-revoke-sub-bba538ea-cmsnx Container started 22m Normal Started pod/maas-api-revoke-sub-1561a7cd-gstql Container started 22m Normal Completed job/maas-api-revoke-sub-b5290ae2 Job completed 22m Normal Created pod/maas-api-revoke-sub-1561a7cd-gstql Container created 22m Normal Created pod/maas-api-revoke-sub-bba538ea-cmsnx Container created 22m Normal Completed job/maas-api-revoke-sub-1bdf0ab2 Job completed 22m Normal Completed job/maas-api-revoke-sub-6587b599 Job completed 22m Normal Completed job/maas-api-revoke-sub-c0a06a41 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-c787ced1 Created pod: maas-api-revoke-sub-c787ced1-7tcjt 22m Normal Completed job/maas-api-revoke-sub-bba538ea Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-8c21b054 Created pod: maas-api-revoke-sub-8c21b054-zq8l4 22m Normal Pulled pod/maas-api-revoke-sub-c787ced1-7tcjt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-c787ced1-7tcjt Container created 22m Normal Started pod/maas-api-revoke-sub-c787ced1-7tcjt Container started 22m Normal Completed job/maas-api-revoke-sub-1561a7cd Job completed 22m Normal AddedInterface pod/maas-api-revoke-sub-c787ced1-7tcjt Add eth0 [10.132.0.150/23] from ovn-kubernetes 22m Normal Started pod/maas-api-revoke-sub-8c21b054-zq8l4 Container started 22m Normal Created pod/maas-api-revoke-sub-8c21b054-zq8l4 Container created 22m Normal Pulled pod/maas-api-revoke-sub-8c21b054-zq8l4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-sub-8c21b054-zq8l4 Add eth0 [10.132.0.151/23] from ovn-kubernetes 22m Normal Completed job/maas-api-revoke-sub-c787ced1 Job completed 22m Normal Completed job/maas-api-revoke-sub-8c21b054 Job completed 22m Normal Killing pod/maas-api-e2e-worker-w1-4eced5-5ff87bf9bd-q4ncv Stopping container maas-api 22m Normal SuccessfulCreate job/maas-api-revoke-sub-8f80204f Created pod: maas-api-revoke-sub-8f80204f-h952z 22m Normal AddedInterface pod/maas-api-revoke-sub-885ff216-96mdg Add eth0 [10.132.0.152/23] from ovn-kubernetes 22m Normal SuccessfulCreate job/maas-api-revoke-sub-885ff216 Created pod: maas-api-revoke-sub-885ff216-96mdg 22m Normal Started pod/maas-api-revoke-sub-8f80204f-h952z Container started 22m Normal AddedInterface pod/maas-api-revoke-sub-8f80204f-h952z Add eth0 [10.132.0.153/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-885ff216-96mdg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-885ff216-96mdg Container created 22m Normal Pulled pod/maas-api-revoke-sub-8f80204f-h952z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-8f80204f-h952z Container created 22m Normal Started pod/maas-api-revoke-sub-885ff216-96mdg Container started 22m Normal Killing pod/maas-api-e2e-worker-w5-0a6da1-7cf4668747-mbztb Stopping container maas-api 22m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-w5-0a6da1 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a6da1: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-w5-0a6da1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-w5-0a6da1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 752a6f0d-c5b4-4de5-a2a3-3327287001b7, UID in object meta: 22m Normal Killing pod/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r Stopping container maas-api 22m Normal Completed job/maas-api-revoke-sub-885ff216 Job completed 22m Normal Completed job/maas-api-revoke-sub-8f80204f Job completed 22m Normal Killing pod/maas-api-e2e-worker-w4-05bc27-5d4f5cf998-gvwwm Stopping container maas-api 21m Normal Killing pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Stopping container maas-api 21m Warning Unhealthy pod/maas-api-e2e-worker-w2-27fdf4-65947f86bd-qxl7l Readiness probe failed: Get "https://10.133.0.45:8443/health": dial tcp 10.133.0.45:8443: connect: connection refused 21m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w6-517149 Created pod: maas-api-revoke-keys-e2e-worker-w6-517149-zpddj 21m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w6-517149-zpddj Add eth0 [10.132.0.155/23] from ovn-kubernetes 21m Normal Started pod/maas-api-revoke-keys-e2e-worker-w6-517149-zpddj Container started 21m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w6-517149-zpddj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-keys-e2e-worker-w6-517149-zpddj Container created 21m Normal Completed job/maas-api-revoke-keys-e2e-worker-w6-517149 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-1c40cee1 Created pod: maas-api-revoke-sub-1c40cee1-6qvvs 21m Normal SuccessfulCreate job/maas-api-revoke-sub-65bf3fab Created pod: maas-api-revoke-sub-65bf3fab-9bkz5 21m Normal Pulled pod/maas-api-revoke-sub-1c40cee1-6qvvs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-sub-65bf3fab-9bkz5 Container created 21m Normal Started pod/maas-api-revoke-sub-65bf3fab-9bkz5 Container started 21m Normal AddedInterface pod/maas-api-revoke-sub-1c40cee1-6qvvs Add eth0 [10.134.0.87/23] from ovn-kubernetes 21m Normal Created pod/maas-api-revoke-sub-1c40cee1-6qvvs Container created 21m Normal Started pod/maas-api-revoke-sub-1c40cee1-6qvvs Container started 21m Normal Pulled pod/maas-api-revoke-sub-65bf3fab-9bkz5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal AddedInterface pod/maas-api-revoke-sub-65bf3fab-9bkz5 Add eth0 [10.132.0.156/23] from ovn-kubernetes 21m Normal Completed job/maas-api-revoke-sub-1c40cee1 Job completed 21m Normal Completed job/maas-api-revoke-sub-65bf3fab Job completed 21m Normal Killing pod/maas-api-e2e-worker-w6-517149-645559575d-f5tl4 Stopping container maas-api 20m Normal SuccessfulCreate job/maas-api-revoke-sub-85237e45 Created pod: maas-api-revoke-sub-85237e45-8lkg8 20m Normal Pulled pod/maas-api-revoke-sub-85237e45-8lkg8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-sub-85237e45-8lkg8 Add eth0 [10.132.0.159/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-sub-85237e45-8lkg8 Container started 20m Normal Created pod/maas-api-revoke-sub-85237e45-8lkg8 Container created 20m Normal Completed job/maas-api-revoke-sub-85237e45 Job completed 19m Normal AddedInterface pod/maas-api-revoke-sub-c1e271a9-gsqkb Add eth0 [10.132.0.161/23] from ovn-kubernetes 19m Normal Created pod/maas-api-revoke-sub-c1e271a9-gsqkb Container created 19m Normal Started pod/maas-api-revoke-sub-c1e271a9-gsqkb Container started 19m Normal Pulled pod/maas-api-revoke-sub-c1e271a9-gsqkb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal SuccessfulCreate job/maas-api-revoke-sub-c1e271a9 Created pod: maas-api-revoke-sub-c1e271a9-gsqkb 19m Normal Completed job/maas-api-revoke-sub-c1e271a9 Job completed 19m Normal Pulled pod/maas-api-revoke-sub-2e1f5b5f-t8brv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-sub-2e1f5b5f-t8brv Add eth0 [10.132.0.162/23] from ovn-kubernetes 19m Normal SuccessfulCreate job/maas-api-revoke-sub-2e1f5b5f Created pod: maas-api-revoke-sub-2e1f5b5f-t8brv 19m Normal Created pod/maas-api-revoke-sub-2e1f5b5f-t8brv Container created 19m Normal Started pod/maas-api-revoke-sub-2e1f5b5f-t8brv Container started 19m Normal Completed job/maas-api-revoke-sub-2e1f5b5f Job completed 19m Normal SuccessfulCreate job/maas-api-revoke-sub-ec843018 Created pod: maas-api-revoke-sub-ec843018-r8dn6 19m Normal Started pod/maas-api-revoke-sub-ec843018-r8dn6 Container started 19m Normal Created pod/maas-api-revoke-sub-ec843018-r8dn6 Container created 19m Normal Pulled pod/maas-api-revoke-sub-ec843018-r8dn6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-sub-ec843018-r8dn6 Add eth0 [10.132.0.163/23] from ovn-kubernetes 19m Normal Completed job/maas-api-revoke-sub-ec843018 Job completed 18m Normal AddedInterface pod/maas-api-revoke-sub-046e1343-j4bcv Add eth0 [10.132.0.164/23] from ovn-kubernetes 18m Normal SuccessfulCreate job/maas-api-revoke-sub-046e1343 Created pod: maas-api-revoke-sub-046e1343-j4bcv 18m Normal Pulled pod/maas-api-revoke-sub-046e1343-j4bcv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Started pod/maas-api-revoke-sub-046e1343-j4bcv Container started 18m Normal Created pod/maas-api-revoke-sub-046e1343-j4bcv Container created 18m Normal Completed job/maas-api-revoke-sub-046e1343 Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-sub-d3fba056 Created pod: maas-api-revoke-sub-d3fba056-8l5lx 18m Normal Started pod/maas-api-revoke-sub-d3fba056-8l5lx Container started 18m Normal Created pod/maas-api-revoke-sub-d3fba056-8l5lx Container created 18m Normal Pulled pod/maas-api-revoke-sub-d3fba056-8l5lx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-sub-d3fba056-8l5lx Add eth0 [10.132.0.165/23] from ovn-kubernetes 18m Normal Completed job/maas-api-revoke-sub-d3fba056 Job completed 18m Normal Pulled pod/maas-api-revoke-sub-ae594979-rz5jq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-sub-ae594979-rz5jq Add eth0 [10.132.0.166/23] from ovn-kubernetes 18m Normal SuccessfulCreate job/maas-api-revoke-sub-ae594979 Created pod: maas-api-revoke-sub-ae594979-rz5jq 18m Normal Created pod/maas-api-revoke-sub-ae594979-rz5jq Container created 18m Normal Started pod/maas-api-revoke-sub-ae594979-rz5jq Container started 18m Normal Completed job/maas-api-revoke-sub-ae594979 Job completed 17m Normal SuccessfulCreate job/maas-api-revoke-sub-a4aef7d7 Created pod: maas-api-revoke-sub-a4aef7d7-9dn9t 17m Normal AddedInterface pod/maas-api-revoke-sub-a4aef7d7-9dn9t Add eth0 [10.132.0.167/23] from ovn-kubernetes 17m Normal Pulled pod/maas-api-revoke-sub-a4aef7d7-9dn9t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Created pod/maas-api-revoke-sub-a4aef7d7-9dn9t Container created 17m Normal Started pod/maas-api-revoke-sub-a4aef7d7-9dn9t Container started 17m Normal Completed job/maas-api-revoke-sub-a4aef7d7 Job completed 17m Normal SuccessfulCreate job/maas-api-revoke-sub-79805ca9 Created pod: maas-api-revoke-sub-79805ca9-6bztw 17m Normal AddedInterface pod/maas-api-revoke-sub-79805ca9-6bztw Add eth0 [10.132.0.168/23] from ovn-kubernetes 17m Normal Pulled pod/maas-api-revoke-sub-79805ca9-6bztw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Started pod/maas-api-revoke-sub-79805ca9-6bztw Container started 17m Normal Created pod/maas-api-revoke-sub-79805ca9-6bztw Container created 17m Normal Completed job/maas-api-revoke-sub-79805ca9 Job completed 17m Normal Pulled pod/maas-api-revoke-sub-0b7e8edb-sx9cr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal SuccessfulCreate job/maas-api-revoke-sub-0b7e8edb Created pod: maas-api-revoke-sub-0b7e8edb-sx9cr 17m Normal AddedInterface pod/maas-api-revoke-sub-0b7e8edb-sx9cr Add eth0 [10.132.0.169/23] from ovn-kubernetes 16m Normal Started pod/maas-api-revoke-sub-0b7e8edb-sx9cr Container started 16m Normal Created pod/maas-api-revoke-sub-0b7e8edb-sx9cr Container created 16m Normal Completed job/maas-api-revoke-sub-0b7e8edb Job completed 16m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-hnnbj 16m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-hnnbj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-hnnbj Add eth0 [10.132.0.170/23] from ovn-kubernetes 16m Normal Started pod/maas-api-revoke-sub-3d4156f1-hnnbj Container started 16m Normal Created pod/maas-api-revoke-sub-3d4156f1-hnnbj Container created 16m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 16m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-dsvpz 16m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-dsvpz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-dsvpz Add eth0 [10.132.0.171/23] from ovn-kubernetes 16m Normal Started pod/maas-api-revoke-sub-3d4156f1-dsvpz Container started 16m Normal Created pod/maas-api-revoke-sub-3d4156f1-dsvpz Container created 16m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 15m Normal SuccessfulCreate job/maas-api-revoke-sub-e2fc9c5b Created pod: maas-api-revoke-sub-e2fc9c5b-wdbm6 15m Normal Pulled pod/maas-api-revoke-sub-e2fc9c5b-wdbm6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-sub-e2fc9c5b-wdbm6 Add eth0 [10.132.0.172/23] from ovn-kubernetes 15m Normal Created pod/maas-api-revoke-sub-e2fc9c5b-wdbm6 Container created 15m Normal Started pod/maas-api-revoke-sub-e2fc9c5b-wdbm6 Container started 15m Normal Completed job/maas-api-revoke-sub-e2fc9c5b Job completed 15m Normal AddedInterface pod/maas-api-revoke-sub-5a29efb3-z9fmf Add eth0 [10.132.0.173/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-sub-5a29efb3 Created pod: maas-api-revoke-sub-5a29efb3-z9fmf 15m Normal Pulled pod/maas-api-revoke-sub-5a29efb3-z9fmf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Started pod/maas-api-revoke-sub-5a29efb3-z9fmf Container started 15m Normal Created pod/maas-api-revoke-sub-5a29efb3-z9fmf Container created 15m Normal Completed job/maas-api-revoke-sub-5a29efb3 Job completed 15m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-zztfl Add eth0 [10.132.0.174/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-zztfl 15m Normal Started pod/maas-api-revoke-sub-3d4156f1-zztfl Container started 15m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-zztfl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-revoke-sub-3d4156f1-zztfl Container created 15m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 14m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9 Created pod: maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb 14m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-9f9b50 Scaled up replica set maas-api-e2e-worker-single-main-9f9b50-645cdcbff9 from 0 to 1 14m Normal Pulled pod/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 367ms (367ms including waiting). Image size: 194581366 bytes. 14m Normal Started pod/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb Container started 14m Normal Pulling pod/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 14m Normal AddedInterface pod/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb Add eth0 [10.133.0.77/23] from ovn-kubernetes 14m Normal Created pod/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb Container created 13m Normal AddedInterface pod/maas-api-revoke-sub-feed85b5-4kr5m Add eth0 [10.132.0.176/23] from ovn-kubernetes 13m Normal Pulled pod/maas-api-revoke-sub-feed85b5-4kr5m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal SuccessfulCreate job/maas-api-revoke-sub-feed85b5 Created pod: maas-api-revoke-sub-feed85b5-4kr5m 13m Normal Created pod/maas-api-revoke-sub-feed85b5-4kr5m Container created 13m Normal Started pod/maas-api-revoke-sub-feed85b5-4kr5m Container started 13m Normal Completed job/maas-api-revoke-sub-feed85b5 Job completed 13m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-9f9b50 Created pod: maas-api-revoke-keys-e2e-worker-single-main-9f9b50-hxfxg 13m Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-9f9b50-hxfxg Container created 13m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-9f9b50-hxfxg Add eth0 [10.132.0.177/23] from ovn-kubernetes 13m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-9f9b50-hxfxg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-9f9b50-hxfxg Container started 13m Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-9f9b50 Job completed 13m Normal Killing pod/maas-api-e2e-worker-single-main-9f9b50-645cdcbff9-q5qlb Stopping container maas-api 13m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-vsjfp 13m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-vsjfp Add eth0 [10.132.0.178/23] from ovn-kubernetes 13m Normal Created pod/maas-api-revoke-sub-3d4156f1-vsjfp Container created 13m Normal Started pod/maas-api-revoke-sub-3d4156f1-vsjfp Container started 13m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-vsjfp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 11m Normal SuccessfulCreate job/maas-api-revoke-sub-d576e68b Created pod: maas-api-revoke-sub-d576e68b-p7szb 11m Normal Pulled pod/maas-api-revoke-sub-d576e68b-p7szb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal AddedInterface pod/maas-api-revoke-sub-d576e68b-p7szb Add eth0 [10.132.0.180/23] from ovn-kubernetes 11m Normal Started pod/maas-api-revoke-sub-d576e68b-p7szb Container started 11m Normal Created pod/maas-api-revoke-sub-d576e68b-p7szb Container created 11m Normal Completed job/maas-api-revoke-sub-d576e68b Job completed 11m Normal AddedInterface pod/maas-api-revoke-sub-d2bc93bc-zxcmq Add eth0 [10.132.0.181/23] from ovn-kubernetes 11m Normal Pulled pod/maas-api-revoke-sub-d2bc93bc-zxcmq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal SuccessfulCreate job/maas-api-revoke-sub-d2bc93bc Created pod: maas-api-revoke-sub-d2bc93bc-zxcmq 11m Normal Started pod/maas-api-revoke-sub-d2bc93bc-zxcmq Container started 11m Normal Created pod/maas-api-revoke-sub-d2bc93bc-zxcmq Container created 11m Normal Completed job/maas-api-revoke-sub-d2bc93bc Job completed 10m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-3503c0 Scaled up replica set maas-api-e2e-worker-single-main-3503c0-55c4fb769b from 0 to 1 10m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-3503c0-55c4fb769b Created pod: maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv 10m Normal Started pod/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv Container started 10m Normal Pulled pod/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 461ms (461ms including waiting). Image size: 194581366 bytes. 10m Normal Created pod/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv Container created 10m Normal Pulling pod/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal AddedInterface pod/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv Add eth0 [10.133.0.80/23] from ovn-kubernetes 10m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-single-main-3503c0 Created job maas-api-key-cleanup-e2e-worker-single-main-3503c0-29895720 10m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29895720 10m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v Add eth0 [10.132.0.183/23] from ovn-kubernetes 10m Normal AddedInterface pod/maas-api-key-cleanup-29895720-h7ffg Add eth0 [10.134.0.90/23] from ovn-kubernetes 10m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-single-main-3503c0-29895720 Created pod: maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v 10m Normal SuccessfulCreate job/maas-api-key-cleanup-29895720 Created pod: maas-api-key-cleanup-29895720-h7ffg 10m Normal Pulled pod/maas-api-key-cleanup-29895720-h7ffg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal Started pod/maas-api-key-cleanup-29895720-h7ffg Container started 10m Normal Created pod/maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v Container created 10m Normal Started pod/maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v Container started 10m Normal Created pod/maas-api-key-cleanup-29895720-h7ffg Container created 10m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Warning BackOff pod/maas-api-key-cleanup-29895720-h7ffg Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29895720-h7ffg_odh-ai-gateway-infra(545bcb9c-7b2f-43a6-b8a4-c53d47525033) 10m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v_odh-ai-gateway-infra(6e5b9a71-89d3-4ea7-97dc-5d3cdf857ed6) 10m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-single-main-3503c0-29895720 Deleted pod: maas-api-key-cleanup-e2e-worker-single-main-3503c0-2989572wz25v 10m Normal SuccessfulDelete job/maas-api-key-cleanup-29895720 Deleted pod: maas-api-key-cleanup-29895720-h7ffg 10m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29895720 Job has reached the specified backoff limit 10m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29895720, condition: Failed 10m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-single-main-3503c0-29895720 Job has reached the specified backoff limit 10m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-single-main-3503c0 Saw completed job: maas-api-key-cleanup-e2e-worker-single-main-3503c0-29895720, condition: Failed 10m Normal Pulled pod/maas-api-revoke-sub-5ecc6d17-8n5wn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal SuccessfulCreate job/maas-api-revoke-sub-5ecc6d17 Created pod: maas-api-revoke-sub-5ecc6d17-8n5wn 10m Normal AddedInterface pod/maas-api-revoke-sub-5ecc6d17-8n5wn Add eth0 [10.132.0.184/23] from ovn-kubernetes 10m Normal Started pod/maas-api-revoke-sub-5ecc6d17-8n5wn Container started 10m Normal Created pod/maas-api-revoke-sub-5ecc6d17-8n5wn Container created 9m59s Normal Completed job/maas-api-revoke-sub-5ecc6d17 Job completed 9m52s Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-3503c0-f29bs Add eth0 [10.132.0.185/23] from ovn-kubernetes 9m52s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-3503c0 Created pod: maas-api-revoke-keys-e2e-worker-single-main-3503c0-f29bs 9m52s Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-3503c0-f29bs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 9m51s Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-3503c0-f29bs Container started 9m51s Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-3503c0-f29bs Container created 9m48s Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-3503c0 Job completed 9m38s Normal Killing pod/maas-api-e2e-worker-single-main-3503c0-55c4fb769b-9c4fv Stopping container maas-api 8m52s Normal SuccessfulCreate job/maas-api-revoke-sub-452b6d7b Created pod: maas-api-revoke-sub-452b6d7b-nmg5l 8m51s Normal Created pod/maas-api-revoke-sub-452b6d7b-nmg5l Container created 8m51s Normal Started pod/maas-api-revoke-sub-452b6d7b-nmg5l Container started 8m51s Normal Pulled pod/maas-api-revoke-sub-452b6d7b-nmg5l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m51s Normal AddedInterface pod/maas-api-revoke-sub-452b6d7b-nmg5l Add eth0 [10.132.0.187/23] from ovn-kubernetes 8m47s Normal Completed job/maas-api-revoke-sub-452b6d7b Job completed 8m30s Normal SuccessfulCreate job/maas-api-revoke-sub-3e31a506 Created pod: maas-api-revoke-sub-3e31a506-cgmkk 8m29s Normal Created pod/maas-api-revoke-sub-3e31a506-cgmkk Container created 8m29s Normal AddedInterface pod/maas-api-revoke-sub-3e31a506-cgmkk Add eth0 [10.132.0.188/23] from ovn-kubernetes 8m29s Normal Pulled pod/maas-api-revoke-sub-3e31a506-cgmkk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m29s Normal Started pod/maas-api-revoke-sub-3e31a506-cgmkk Container started 8m25s Normal Completed job/maas-api-revoke-sub-3e31a506 Job completed 7m59s Normal AddedInterface pod/maas-api-revoke-sub-56327c97-z4lt4 Add eth0 [10.132.0.189/23] from ovn-kubernetes 7m59s Normal Pulled pod/maas-api-revoke-sub-56327c97-z4lt4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 7m59s Normal SuccessfulCreate job/maas-api-revoke-sub-56327c97 Created pod: maas-api-revoke-sub-56327c97-z4lt4 7m58s Normal Started pod/maas-api-revoke-sub-56327c97-z4lt4 Container started 7m58s Normal Created pod/maas-api-revoke-sub-56327c97-z4lt4 Container created 7m55s Normal Completed job/maas-api-revoke-sub-56327c97 Job completed 7m47s Normal SuccessfulCreate replicaset/maas-api-cb9fbb88b Created pod: maas-api-cb9fbb88b-56xzv 7m47s Normal SuccessfulCreate replicaset/maas-api-7458978ff4 Created pod: maas-api-7458978ff4-4djcb 7m47s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-7458978ff4 from 1 to 2 7m47s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-cb9fbb88b from 0 to 1 7m46s Normal Pulled pod/maas-api-cb9fbb88b-56xzv Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 311ms (311ms including waiting). Image size: 194581366 bytes. 7m46s Normal Started pod/maas-api-cb9fbb88b-56xzv Container started 7m46s Normal Pulling pod/maas-api-7458978ff4-4djcb Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 7m46s Normal Pulled pod/maas-api-7458978ff4-4djcb Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 379ms (379ms including waiting). Image size: 194581366 bytes. 7m46s Normal Created pod/maas-api-7458978ff4-4djcb Container created 7m46s Normal Started pod/maas-api-7458978ff4-4djcb Container started 7m46s Normal AddedInterface pod/maas-api-7458978ff4-4djcb Add eth0 [10.134.0.91/23] from ovn-kubernetes 7m46s Normal Pulling pod/maas-api-cb9fbb88b-56xzv Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 7m46s Normal AddedInterface pod/maas-api-cb9fbb88b-56xzv Add eth0 [10.133.0.84/23] from ovn-kubernetes 7m46s Normal Created pod/maas-api-cb9fbb88b-56xzv Container created 7m40s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-cb9fbb88b from 1 to 2 7m40s Normal SuccessfulDelete replicaset/maas-api-7458978ff4 Deleted pod: maas-api-7458978ff4-4djcb 7m40s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-7458978ff4 from 2 to 1 7m40s Normal Killing pod/maas-api-7458978ff4-4djcb Stopping container maas-api 7m40s Normal SuccessfulCreate replicaset/maas-api-cb9fbb88b Created pod: maas-api-cb9fbb88b-jhpwk 7m39s Normal AddedInterface pod/maas-api-cb9fbb88b-jhpwk Add eth0 [10.134.0.92/23] from ovn-kubernetes 7m39s Normal Pulling pod/maas-api-cb9fbb88b-jhpwk Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 7m39s Normal Pulled pod/maas-api-cb9fbb88b-jhpwk Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 303ms (303ms including waiting). Image size: 194581366 bytes. 7m38s Normal Created pod/maas-api-cb9fbb88b-jhpwk Container created 7m38s Normal Started pod/maas-api-cb9fbb88b-jhpwk Container started 7m32s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-7458978ff4 from 1 to 0 7m32s Normal SuccessfulDelete replicaset/maas-api-7458978ff4 Deleted pod: maas-api-7458978ff4-76djf 7m32s Normal Killing pod/maas-api-7458978ff4-76djf Stopping container maas-api 7m24s Normal ScalingReplicaSet deployment/maas-api-e2e-ait-b14ec9a0 Scaled up replica set maas-api-e2e-ait-b14ec9a0-68cff875fd from 0 to 1 7m24s Normal SuccessfulCreate replicaset/maas-api-e2e-ait-b14ec9a0-68cff875fd Created pod: maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk 7m23s Normal AddedInterface pod/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk Add eth0 [10.133.0.87/23] from ovn-kubernetes 7m23s Normal Pulling pod/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 7m23s Normal Pulled pod/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 287ms (287ms including waiting). Image size: 194581366 bytes. 7m23s Normal Started pod/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk Container started 7m23s Normal Created pod/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk Container created 7m11s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-b14ec9a0 Created pod: maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 7m10s Warning FailedMount pod/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 MountVolume.SetUp failed for volume "kube-api-access-djwnx" : failed to fetch token: serviceaccounts "maas-api-cleanup" not found 7m8s Normal Pulled pod/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 7m8s Normal Started pod/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 Container started 7m8s Normal Created pod/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 Container created 7m8s Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 Add eth0 [10.132.0.191/23] from ovn-kubernetes 7m8s Warning FailedToRetrieveImagePullSecret pod/maas-api-revoke-keys-e2e-ait-b14ec9a0-rlt66 Unable to retrieve some image pull secrets (maas-api-cleanup-dockercfg-p4zs2); attempting to pull the image may not succeed. 7m5s Normal Completed job/maas-api-revoke-keys-e2e-ait-b14ec9a0 Job completed 6m59s Normal Killing pod/maas-api-e2e-ait-b14ec9a0-68cff875fd-c8xvk Stopping container maas-api 6m48s Normal ScalingReplicaSet deployment/maas-api-e2e-authcfg-http-6a697e Scaled up replica set maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b from 0 to 1 6m47s Normal AddedInterface pod/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs Add eth0 [10.133.0.89/23] from ovn-kubernetes 6m47s Normal SuccessfulCreate replicaset/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b Created pod: maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs 6m47s Normal Pulled pod/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 306ms (306ms including waiting). Image size: 194581366 bytes. 6m47s Normal Pulling pod/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 6m46s Normal Started pod/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs Container started 6m46s Normal Created pod/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs Container created 5m14s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-authcfg-http-6a697e Created pod: maas-api-revoke-keys-e2e-authcfg-http-6a697e-g6m2t 5m13s Normal Created pod/maas-api-revoke-keys-e2e-authcfg-http-6a697e-g6m2t Container created 5m13s Normal Pulled pod/maas-api-revoke-keys-e2e-authcfg-http-6a697e-g6m2t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 5m13s Normal AddedInterface pod/maas-api-revoke-keys-e2e-authcfg-http-6a697e-g6m2t Add eth0 [10.132.0.194/23] from ovn-kubernetes 5m13s Normal Started pod/maas-api-revoke-keys-e2e-authcfg-http-6a697e-g6m2t Container started 5m10s Normal Completed job/maas-api-revoke-keys-e2e-authcfg-http-6a697e Job completed 4m57s Normal Killing pod/maas-api-e2e-authcfg-http-6a697e-8f6d7ff9b-72nhs Stopping container maas-api 4m32s Normal SuccessfulCreate job/maas-api-revoke-sub-f03629db Created pod: maas-api-revoke-sub-f03629db-4qvl2 4m32s Normal AddedInterface pod/maas-api-revoke-sub-f03629db-4qvl2 Add eth0 [10.132.0.195/23] from ovn-kubernetes 4m31s Normal Started pod/maas-api-revoke-sub-f03629db-4qvl2 Container started 4m31s Normal Pulled pod/maas-api-revoke-sub-f03629db-4qvl2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m31s Normal Created pod/maas-api-revoke-sub-f03629db-4qvl2 Container created 4m28s Normal Completed job/maas-api-revoke-sub-f03629db Job completed 4m15s Normal SuccessfulCreate job/maas-api-revoke-sub-0165d7d2 Created pod: maas-api-revoke-sub-0165d7d2-rplcw 4m14s Normal AddedInterface pod/maas-api-revoke-sub-0165d7d2-rplcw Add eth0 [10.132.0.196/23] from ovn-kubernetes 4m14s Normal Pulled pod/maas-api-revoke-sub-0165d7d2-rplcw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m14s Normal Created pod/maas-api-revoke-sub-0165d7d2-rplcw Container created 4m14s Normal Started pod/maas-api-revoke-sub-0165d7d2-rplcw Container started 4m10s Normal Completed job/maas-api-revoke-sub-0165d7d2 Job completed 4m4s Normal SuccessfulCreate job/maas-api-revoke-sub-6b19338f Created pod: maas-api-revoke-sub-6b19338f-xkkmg 4m3s Normal AddedInterface pod/maas-api-revoke-sub-6b19338f-xkkmg Add eth0 [10.132.0.197/23] from ovn-kubernetes 4m3s Normal Pulled pod/maas-api-revoke-sub-6b19338f-xkkmg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m3s Normal Created pod/maas-api-revoke-sub-6b19338f-xkkmg Container created 4m3s Normal Started pod/maas-api-revoke-sub-6b19338f-xkkmg Container started 3m59s Normal Completed job/maas-api-revoke-sub-6b19338f Job completed