=== events in odh-ai-gateway-infra (2026-10-31T08:13:22Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 15m Normal Scheduled pod/maas-api-revoke-sub-d2bc93bc-g7tm9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-g7tm9 to ip-10-0-140-236.ec2.internal 7m38s Normal Scheduled pod/maas-api-revoke-keys-e2e-authcfg-http-0503df-5hvgt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-0503df-5hvgt to ip-10-0-140-236.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-6ac71db4-k924w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6ac71db4-k924w to ip-10-0-140-236.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-31de0bd4-jnnnm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw to ip-10-0-128-20.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-c1e271a9-6fnpr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-c2b0f715-kqgr6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c2b0f715-kqgr6 to ip-10-0-140-236.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-3061197b-7fwnq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3061197b-7fwnq to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-6ab5bda7-cw5g7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6ab5bda7-cw5g7 to ip-10-0-140-236.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-5a29efb3-r5xh6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-r5xh6 to ip-10-0-140-236.ec2.internal 10m Normal Scheduled pod/maas-api-79fc8bc9c5-fn6ck Successfully assigned odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck to ip-10-0-128-20.ec2.internal 6m11s Normal Scheduled pod/maas-api-revoke-sub-6b19338f-nfrp9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-nfrp9 to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-6f7bf75b-nwmh2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6f7bf75b-nwmh2 to ip-10-0-140-236.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-2e1f5b5f-vxzlr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr to ip-10-0-128-20.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-c8758b4b-ks5zs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c8758b4b-ks5zs to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd to ip-10-0-140-236.ec2.internal 37m Normal Scheduled pod/maas-api-6d669c7fcd-qbhd8 Successfully assigned odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8 to ip-10-0-128-20.ec2.internal 37m Normal Scheduled pod/maas-api-79fc8bc9c5-jdz9r Successfully assigned odh-ai-gateway-infra/maas-api-79fc8bc9c5-jdz9r to ip-10-0-136-217.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-2482a204-nt5lp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2482a204-nt5lp to ip-10-0-140-236.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-b91fa08f-8h6gg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b91fa08f-8h6gg to ip-10-0-140-236.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-1d700421-47mdl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1d700421-47mdl to ip-10-0-140-236.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-7748bfb0-dzl64 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7748bfb0-dzl64 to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-cac1558a-f5r5q Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cac1558a-f5r5q to ip-10-0-140-236.ec2.internal 38m Normal Scheduled pod/postgres-7cdbf6dc44-8fr55 Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55 to ip-10-0-128-20.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-3687bccb-9rqzs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3687bccb-9rqzs to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-5441a05e-k4kcb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5441a05e-k4kcb to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 to ip-10-0-136-217.ec2.internal 10m Normal Scheduled pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f to ip-10-0-136-217.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-8c158eef-9j9pc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8c158eef-9j9pc to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-ce101d99-vzq94 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ce101d99-vzq94 to ip-10-0-140-236.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-3e31a506-hpqcq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-hpqcq to ip-10-0-140-236.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-046e1343-p49k5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5 to ip-10-0-128-20.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-8880ccd8-grpwx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8880ccd8-grpwx to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w5-b1fda4-6ntq5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-b1fda4-6ntq5 to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-febff933-2q6pn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-febff933-2q6pn to ip-10-0-140-236.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-091c1d6e-cb4bs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w4-3dff3f-qkrhk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-3dff3f-qkrhk to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-85e990ba-pkb7p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85e990ba-pkb7p to ip-10-0-140-236.ec2.internal 9m12s Normal Scheduled pod/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb to ip-10-0-136-217.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-85237e45-klg8z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-0b4919ba-xjbhz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b4919ba-xjbhz to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-8f468be1-jhgkc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8f468be1-jhgkc to ip-10-0-140-236.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-fb4a57ce-zvnb7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fb4a57ce-zvnb7 to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-fb31e973-44vn2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2 to ip-10-0-128-20.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-f48b9cf3-z9vq4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4 to ip-10-0-128-20.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-45190c6a-xpssh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-45190c6a-xpssh to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82 to ip-10-0-128-20.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-sftn4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-sftn4 to ip-10-0-140-236.ec2.internal 19m Normal Scheduled pod/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm to ip-10-0-136-217.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-976fb0cc-sc5lm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-976fb0cc-sc5lm to ip-10-0-140-236.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-0b7e8edb-7chr9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-7chr9 to ip-10-0-140-236.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47 to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-f09760dd-7ltcl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f09760dd-7ltcl to ip-10-0-140-236.ec2.internal 6m47s Normal Scheduled pod/maas-api-revoke-sub-f03629db-p4t2z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-p4t2z to ip-10-0-140-236.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-sub-ef47abfe-h4hhq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ef47abfe-h4hhq to ip-10-0-140-236.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-ec843018-szqzd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-e93e4474-c6l5h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e93e4474-c6l5h to ip-10-0-140-236.ec2.internal 14m Normal Scheduled pod/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc to ip-10-0-136-217.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-e8ab697c-jlkkn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e8ab697c-jlkkn to ip-10-0-140-236.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-e2fc9c5b-244lv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-244lv to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-7dd675ee-v2q49 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7dd675ee-v2q49 to ip-10-0-140-236.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-79805ca9-gh6jn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn to ip-10-0-128-20.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-157e87f5-2jtd9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-157e87f5-2jtd9 to ip-10-0-140-236.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-b69cdb34-2zbbp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b69cdb34-2zbbp to ip-10-0-140-236.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-b0a3ab8e-ksl98 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b0a3ab8e-ksl98 to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-980d26c0-7j78w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-980d26c0-7j78w to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-dd02f45f-kltxs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-dd02f45f-kltxs to ip-10-0-140-236.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq to ip-10-0-128-20.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-ae594979-m2558 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558 to ip-10-0-128-20.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-fd18eeb3-fdg87 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd18eeb3-fdg87 to ip-10-0-140-236.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-a99c7c66-hbpp8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a99c7c66-hbpp8 to ip-10-0-140-236.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-d1f09f4c-wwqt4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d1f09f4c-wwqt4 to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-d20bfd47-9dbnh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d20bfd47-9dbnh to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w1-4794f5-fxvb2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-4794f5-fxvb2 to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm to ip-10-0-128-20.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-d24c28d0-88b2b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d24c28d0-88b2b to ip-10-0-140-236.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr to ip-10-0-136-217.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-a79e028f-vb6md Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a79e028f-vb6md to ip-10-0-140-236.ec2.internal 13m Normal Scheduled pod/maas-api-key-cleanup-29890560-vjqrf Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29890560-vjqrf to ip-10-0-140-236.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-009b0f-gc7df Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-009b0f-gc7df to ip-10-0-140-236.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-a4aef7d7-2jfwt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt to ip-10-0-128-20.ec2.internal 6m22s Normal Scheduled pod/maas-api-revoke-sub-0165d7d2-z9vwr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-z9vwr to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-dac3004d-6hnjv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv to ip-10-0-128-20.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-a131f47a-mltx2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2 to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-bc19f141-6kzlc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bc19f141-6kzlc to ip-10-0-140-236.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm to ip-10-0-136-217.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-d3fba056-46xh5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5 to ip-10-0-128-20.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-d48db09e-qqnwf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d48db09e-qqnwf to ip-10-0-140-236.ec2.internal 13m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-11a81e-pw4w7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-11a81e-pw4w7 to ip-10-0-140-236.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-5g999 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-5g999 to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-98b9bfe2-qq66k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-98b9bfe2-qq66k to ip-10-0-140-236.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-fppgp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-fppgp to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-key-cleanup-29890545-jjm7v Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v to ip-10-0-128-20.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-d576e68b-9xzhh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-9xzhh to ip-10-0-140-236.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd to ip-10-0-136-217.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-d7e07fc7-lhc2b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d7e07fc7-lhc2b to ip-10-0-140-236.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w0-648fbe-xn97x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-648fbe-xn97x to ip-10-0-140-236.ec2.internal 10m Normal Scheduled pod/maas-api-f4d8b9659-rbhwr Successfully assigned odh-ai-gateway-infra/maas-api-f4d8b9659-rbhwr to ip-10-0-136-217.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-137733a5-xrrnc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-137733a5-xrrnc to ip-10-0-140-236.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-117782a3-bv6xl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-117782a3-bv6xl to ip-10-0-140-236.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-d95db595-2jc5b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d95db595-2jc5b to ip-10-0-140-236.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w6-027d2a-tmpqp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-027d2a-tmpqp to ip-10-0-140-236.ec2.internal 10m Normal Scheduled pod/maas-api-f4d8b9659-ncxh7 Successfully assigned odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7 to ip-10-0-128-20.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 to ip-10-0-128-20.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-5mg6p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-5mg6p to ip-10-0-140-236.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-518aac12-8p8tj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-518aac12-8p8tj to ip-10-0-140-236.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 to ip-10-0-128-20.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-4ffdd5d6-wwz4g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4ffdd5d6-wwz4g to ip-10-0-140-236.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp to ip-10-0-136-217.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-452b6d7b-k46ml Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-k46ml to ip-10-0-140-236.ec2.internal 38m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 38m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-8fr55 38m Normal AddedInterface pod/postgres-7cdbf6dc44-8fr55 Add eth0 [10.132.0.49/23] from ovn-kubernetes 38m Normal Pulling pod/postgres-7cdbf6dc44-8fr55 Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 38m Normal Pulled pod/postgres-7cdbf6dc44-8fr55 Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 4.969s (4.969s including waiting). Image size: 403732742 bytes. 38m Normal Created pod/postgres-7cdbf6dc44-8fr55 Container created 38m Normal Started pod/postgres-7cdbf6dc44-8fr55 Container started 37m Warning FailedCreate replicaset/maas-api-6d669c7fcd Error creating: pods "maas-api-6d669c7fcd-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 37m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-6d669c7fcd from 0 to 1 37m Normal SuccessfulCreate replicaset/maas-api-6d669c7fcd Created pod: maas-api-6d669c7fcd-qbhd8 37m Normal Pulling pod/maas-api-6d669c7fcd-qbhd8 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 37m Normal AddedInterface pod/maas-api-6d669c7fcd-qbhd8 Add eth0 [10.132.0.55/23] from ovn-kubernetes 37m Normal Pulled pod/maas-api-6d669c7fcd-qbhd8 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.79s (1.79s including waiting). Image size: 194581366 bytes. 37m Normal Created pod/maas-api-6d669c7fcd-qbhd8 Container created 37m Normal Started pod/maas-api-6d669c7fcd-qbhd8 Container started 37m Normal SuccessfulCreate replicaset/maas-api-79fc8bc9c5 Created pod: maas-api-79fc8bc9c5-jdz9r 37m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-79fc8bc9c5 from 0 to 1 37m Normal AddedInterface pod/maas-api-79fc8bc9c5-jdz9r Add eth0 [10.133.0.27/23] from ovn-kubernetes 37m Normal Pulling pod/maas-api-79fc8bc9c5-jdz9r Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 36m Normal Pulled pod/maas-api-79fc8bc9c5-jdz9r Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.578s (1.578s including waiting). Image size: 194581366 bytes. 36m Normal Created pod/maas-api-79fc8bc9c5-jdz9r Container created 36m Normal Started pod/maas-api-79fc8bc9c5-jdz9r Container started 36m Normal SuccessfulDelete replicaset/maas-api-6d669c7fcd Deleted pod: maas-api-6d669c7fcd-qbhd8 36m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-6d669c7fcd from 1 to 0 36m Normal Killing pod/maas-api-6d669c7fcd-qbhd8 Stopping container maas-api 34m Normal AddedInterface pod/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd Add eth0 [10.133.0.38/23] from ovn-kubernetes 34m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-3cc201-794db477f8 Created pod: maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd 34m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-3cc201 Scaled up replica set maas-api-e2e-worker-w3-3cc201-794db477f8 from 0 to 1 34m Normal Pulling pod/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal Started pod/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd Container started 34m Normal Created pod/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd Container created 34m Normal Pulled pod/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 465ms (465ms including waiting). Image size: 194581366 bytes. 34m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-027d2a Scaled up replica set maas-api-e2e-worker-w6-027d2a-59b44f6fc5 from 0 to 1 34m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-027d2a-59b44f6fc5 Created pod: maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 34m Normal Pulled pod/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 268ms (268ms including waiting). Image size: 194581366 bytes. 34m Normal Pulling pod/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal AddedInterface pod/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 Add eth0 [10.132.0.66/23] from ovn-kubernetes 34m Normal Started pod/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 Container started 34m Normal Created pod/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 Container created 34m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4 Created pod: maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp 34m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-b1fda4 Scaled up replica set maas-api-e2e-worker-w5-b1fda4-6cfb47bc4 from 0 to 1 34m Normal Pulled pod/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 304ms (304ms including waiting). Image size: 194581366 bytes. 34m Normal Started pod/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp Container started 34m Normal Created pod/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp Container created 34m Normal Pulling pod/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal AddedInterface pod/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp Add eth0 [10.133.0.39/23] from ovn-kubernetes 34m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-3dff3f-b8fd9f475 Created pod: maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 34m Normal AddedInterface pod/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 Add eth0 [10.132.0.67/23] from ovn-kubernetes 34m Normal Pulling pod/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-3dff3f Scaled up replica set maas-api-e2e-worker-w4-3dff3f-b8fd9f475 from 0 to 1 34m Normal Created pod/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 Container created 34m Normal Pulled pod/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 274ms (274ms including waiting). Image size: 194581366 bytes. 34m Normal Started pod/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 Container started 34m Normal Pulling pod/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal AddedInterface pod/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr Add eth0 [10.133.0.42/23] from ovn-kubernetes 34m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-4794f5-85f66f7bf Created pod: maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr 34m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-4794f5 Scaled up replica set maas-api-e2e-worker-w1-4794f5-85f66f7bf from 0 to 1 34m Normal Pulled pod/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 284ms (284ms including waiting). Image size: 194581366 bytes. 34m Normal Created pod/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr Container created 34m Normal Started pod/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr Container started 34m Normal AddedInterface pod/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq Add eth0 [10.132.0.68/23] from ovn-kubernetes 34m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6 Created pod: maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq 34m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-648fbe Scaled up replica set maas-api-e2e-worker-w0-648fbe-7dbdc79fc6 from 0 to 1 34m Normal Pulling pod/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal Created pod/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq Container created 34m Normal Started pod/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq Container started 34m Normal Pulled pod/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 282ms (282ms including waiting). Image size: 194581366 bytes. 34m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-b4e8fd Scaled up replica set maas-api-e2e-worker-w2-b4e8fd-6bf66f4598 from 0 to 1 34m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598 Created pod: maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm 34m Normal Started pod/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm Container started 34m Normal Created pod/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm Container created 34m Normal Pulled pod/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 343ms (343ms including waiting). Image size: 194581366 bytes. 34m Normal Pulling pod/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal AddedInterface pod/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm Add eth0 [10.133.0.43/23] from ovn-kubernetes 32m Normal SuccessfulCreate job/maas-api-revoke-sub-7748bfb0 Created pod: maas-api-revoke-sub-7748bfb0-dzl64 32m Normal Pulling pod/maas-api-revoke-sub-7748bfb0-dzl64 Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 32m Normal AddedInterface pod/maas-api-revoke-sub-7748bfb0-dzl64 Add eth0 [10.134.0.56/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-7748bfb0-dzl64 Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.695s (2.695s including waiting). Image size: 107195206 bytes. 32m Normal Created pod/maas-api-revoke-sub-7748bfb0-dzl64 Container created 32m Normal Started pod/maas-api-revoke-sub-7748bfb0-dzl64 Container started 32m Normal Completed job/maas-api-revoke-sub-7748bfb0 Job completed 32m Normal AddedInterface pod/maas-api-revoke-sub-a79e028f-vb6md Add eth0 [10.134.0.58/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-a79e028f-vb6md Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal SuccessfulCreate job/maas-api-revoke-sub-a79e028f Created pod: maas-api-revoke-sub-a79e028f-vb6md 32m Normal Created pod/maas-api-revoke-sub-a79e028f-vb6md Container created 32m Normal Started pod/maas-api-revoke-sub-a79e028f-vb6md Container started 32m Normal Completed job/maas-api-revoke-sub-a79e028f Job completed 32m Normal SuccessfulCreate job/maas-api-revoke-sub-137733a5 Created pod: maas-api-revoke-sub-137733a5-xrrnc 32m Normal Created pod/maas-api-revoke-sub-137733a5-xrrnc Container created 32m Normal Started pod/maas-api-revoke-sub-137733a5-xrrnc Container started 32m Normal AddedInterface pod/maas-api-revoke-sub-137733a5-xrrnc Add eth0 [10.134.0.59/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-137733a5-xrrnc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Completed job/maas-api-revoke-sub-137733a5 Job completed 32m Normal SuccessfulCreate job/maas-api-revoke-sub-d24c28d0 Created pod: maas-api-revoke-sub-d24c28d0-88b2b 32m Normal AddedInterface pod/maas-api-revoke-sub-d24c28d0-88b2b Add eth0 [10.134.0.61/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-d24c28d0-88b2b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Created pod/maas-api-revoke-sub-d24c28d0-88b2b Container created 32m Normal SuccessfulCreate job/maas-api-revoke-sub-fb4a57ce Created pod: maas-api-revoke-sub-fb4a57ce-zvnb7 32m Normal Started pod/maas-api-revoke-sub-d24c28d0-88b2b Container started 32m Normal AddedInterface pod/maas-api-revoke-sub-fb4a57ce-zvnb7 Add eth0 [10.134.0.62/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-fb4a57ce-zvnb7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Created pod/maas-api-revoke-sub-fb4a57ce-zvnb7 Container created 32m Normal Started pod/maas-api-revoke-sub-fb4a57ce-zvnb7 Container started 32m Normal Completed job/maas-api-revoke-sub-d24c28d0 Job completed 32m Normal Completed job/maas-api-revoke-sub-fb4a57ce Job completed 32m Normal SuccessfulCreate job/maas-api-revoke-sub-a99c7c66 Created pod: maas-api-revoke-sub-a99c7c66-hbpp8 32m Normal AddedInterface pod/maas-api-revoke-sub-a99c7c66-hbpp8 Add eth0 [10.134.0.63/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-a99c7c66-hbpp8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Created pod/maas-api-revoke-sub-a99c7c66-hbpp8 Container created 32m Normal Started pod/maas-api-revoke-sub-a99c7c66-hbpp8 Container started 32m Normal Completed job/maas-api-revoke-sub-a99c7c66 Job completed 31m Normal AddedInterface pod/maas-api-revoke-sub-85e990ba-pkb7p Add eth0 [10.134.0.65/23] from ovn-kubernetes 31m Normal SuccessfulCreate job/maas-api-revoke-sub-85e990ba Created pod: maas-api-revoke-sub-85e990ba-pkb7p 31m Normal Pulled pod/maas-api-revoke-sub-85e990ba-pkb7p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Started pod/maas-api-revoke-sub-85e990ba-pkb7p Container started 31m Normal Created pod/maas-api-revoke-sub-85e990ba-pkb7p Container created 31m Normal SuccessfulCreate job/maas-api-revoke-sub-dd02f45f Created pod: maas-api-revoke-sub-dd02f45f-kltxs 31m Normal SuccessfulCreate job/maas-api-revoke-sub-518aac12 Created pod: maas-api-revoke-sub-518aac12-8p8tj 31m Normal Created pod/maas-api-revoke-sub-dd02f45f-kltxs Container created 31m Normal Started pod/maas-api-revoke-sub-dd02f45f-kltxs Container started 31m Normal Started pod/maas-api-revoke-sub-518aac12-8p8tj Container started 31m Normal Created pod/maas-api-revoke-sub-518aac12-8p8tj Container created 31m Normal Pulled pod/maas-api-revoke-sub-dd02f45f-kltxs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-518aac12-8p8tj Add eth0 [10.134.0.67/23] from ovn-kubernetes 31m Normal AddedInterface pod/maas-api-revoke-sub-dd02f45f-kltxs Add eth0 [10.134.0.66/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-sub-518aac12-8p8tj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal SuccessfulCreate job/maas-api-revoke-sub-98b9bfe2 Created pod: maas-api-revoke-sub-98b9bfe2-qq66k 31m Normal AddedInterface pod/maas-api-revoke-sub-6ab5bda7-cw5g7 Add eth0 [10.134.0.69/23] from ovn-kubernetes 31m Normal Created pod/maas-api-revoke-sub-98b9bfe2-qq66k Container created 31m Normal SuccessfulCreate job/maas-api-revoke-sub-6ab5bda7 Created pod: maas-api-revoke-sub-6ab5bda7-cw5g7 31m Normal AddedInterface pod/maas-api-revoke-sub-98b9bfe2-qq66k Add eth0 [10.134.0.68/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-sub-6ab5bda7-cw5g7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Completed job/maas-api-revoke-sub-85e990ba Job completed 31m Normal Pulled pod/maas-api-revoke-sub-98b9bfe2-qq66k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Started pod/maas-api-revoke-sub-98b9bfe2-qq66k Container started 31m Normal Started pod/maas-api-revoke-sub-6ab5bda7-cw5g7 Container started 31m Normal Created pod/maas-api-revoke-sub-6ab5bda7-cw5g7 Container created 31m Normal Completed job/maas-api-revoke-sub-dd02f45f Job completed 31m Normal Completed job/maas-api-revoke-sub-518aac12 Job completed 31m Normal Completed job/maas-api-revoke-sub-98b9bfe2 Job completed 31m Normal Completed job/maas-api-revoke-sub-6ab5bda7 Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-sub-c8758b4b Created pod: maas-api-revoke-sub-c8758b4b-ks5zs 31m Normal Created pod/maas-api-revoke-sub-c8758b4b-ks5zs Container created 31m Normal Started pod/maas-api-revoke-sub-c8758b4b-ks5zs Container started 31m Normal Pulled pod/maas-api-revoke-sub-c8758b4b-ks5zs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-c8758b4b-ks5zs Add eth0 [10.134.0.70/23] from ovn-kubernetes 31m Normal Completed job/maas-api-revoke-sub-c8758b4b Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-sub-45190c6a Created pod: maas-api-revoke-sub-45190c6a-xpssh 31m Normal AddedInterface pod/maas-api-revoke-sub-45190c6a-xpssh Add eth0 [10.134.0.71/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-sub-45190c6a-xpssh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-api-revoke-sub-45190c6a-xpssh Container created 31m Normal Started pod/maas-api-revoke-sub-45190c6a-xpssh Container started 31m Normal Completed job/maas-api-revoke-sub-45190c6a Job completed 31m Normal Pulled pod/maas-api-revoke-sub-febff933-2q6pn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal SuccessfulCreate job/maas-api-revoke-sub-febff933 Created pod: maas-api-revoke-sub-febff933-2q6pn 31m Normal AddedInterface pod/maas-api-revoke-sub-febff933-2q6pn Add eth0 [10.134.0.73/23] from ovn-kubernetes 31m Normal Started pod/maas-api-revoke-sub-febff933-2q6pn Container started 31m Normal Created pod/maas-api-revoke-sub-febff933-2q6pn Container created 31m Normal SuccessfulCreate job/maas-api-revoke-sub-8f468be1 Created pod: maas-api-revoke-sub-8f468be1-jhgkc 31m Normal Completed job/maas-api-revoke-sub-febff933 Job completed 31m Normal AddedInterface pod/maas-api-revoke-sub-8f468be1-jhgkc Add eth0 [10.134.0.74/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-sub-8f468be1-jhgkc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-api-revoke-sub-8f468be1-jhgkc Container created 31m Normal Started pod/maas-api-revoke-sub-8f468be1-jhgkc Container started 31m Normal Completed job/maas-api-revoke-sub-8f468be1 Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-sub-5441a05e Created pod: maas-api-revoke-sub-5441a05e-k4kcb 31m Normal Pulled pod/maas-api-revoke-sub-5441a05e-k4kcb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-5441a05e-k4kcb Add eth0 [10.134.0.75/23] from ovn-kubernetes 31m Normal Created pod/maas-api-revoke-sub-5441a05e-k4kcb Container created 31m Normal Started pod/maas-api-revoke-sub-5441a05e-k4kcb Container started 31m Normal SuccessfulCreate job/maas-api-revoke-sub-ce101d99 Created pod: maas-api-revoke-sub-ce101d99-vzq94 31m Normal Started pod/maas-api-revoke-sub-ce101d99-vzq94 Container started 31m Normal Created pod/maas-api-revoke-sub-ce101d99-vzq94 Container created 31m Normal AddedInterface pod/maas-api-revoke-sub-ce101d99-vzq94 Add eth0 [10.134.0.77/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-sub-ce101d99-vzq94 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Completed job/maas-api-revoke-sub-5441a05e Job completed 31m Normal Completed job/maas-api-revoke-sub-ce101d99 Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-sub-d20bfd47 Created pod: maas-api-revoke-sub-d20bfd47-9dbnh 31m Normal Started pod/maas-api-revoke-sub-d20bfd47-9dbnh Container started 31m Normal Created pod/maas-api-revoke-sub-d20bfd47-9dbnh Container created 31m Normal Pulled pod/maas-api-revoke-sub-d20bfd47-9dbnh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-d20bfd47-9dbnh Add eth0 [10.134.0.79/23] from ovn-kubernetes 31m Normal Completed job/maas-api-revoke-sub-d20bfd47 Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-sub-d7e07fc7 Created pod: maas-api-revoke-sub-d7e07fc7-lhc2b 31m Normal Pulled pod/maas-api-revoke-sub-d7e07fc7-lhc2b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Started pod/maas-api-revoke-sub-d7e07fc7-lhc2b Container started 31m Normal Created pod/maas-api-revoke-sub-d7e07fc7-lhc2b Container created 31m Normal AddedInterface pod/maas-api-revoke-sub-d7e07fc7-lhc2b Add eth0 [10.134.0.82/23] from ovn-kubernetes 30m Normal SuccessfulCreate job/maas-api-revoke-sub-b0a3ab8e Created pod: maas-api-revoke-sub-b0a3ab8e-ksl98 30m Normal Completed job/maas-api-revoke-sub-d7e07fc7 Job completed 30m Normal Started pod/maas-api-revoke-sub-b0a3ab8e-ksl98 Container started 30m Normal Created pod/maas-api-revoke-sub-b0a3ab8e-ksl98 Container created 30m Normal Pulled pod/maas-api-revoke-sub-b0a3ab8e-ksl98 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-sub-b0a3ab8e-ksl98 Add eth0 [10.134.0.83/23] from ovn-kubernetes 30m Normal Completed job/maas-api-revoke-sub-b0a3ab8e Job completed 30m Normal AddedInterface pod/maas-api-revoke-sub-8880ccd8-grpwx Add eth0 [10.134.0.85/23] from ovn-kubernetes 30m Normal SuccessfulCreate job/maas-api-revoke-sub-8880ccd8 Created pod: maas-api-revoke-sub-8880ccd8-grpwx 30m Normal Started pod/maas-api-revoke-sub-8880ccd8-grpwx Container started 30m Normal Pulled pod/maas-api-revoke-sub-8880ccd8-grpwx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-revoke-sub-8880ccd8-grpwx Container created 30m Normal Completed job/maas-api-revoke-sub-8880ccd8 Job completed 30m Normal SuccessfulCreate job/maas-api-revoke-sub-2482a204 Created pod: maas-api-revoke-sub-2482a204-nt5lp 30m Normal Created pod/maas-api-revoke-sub-2482a204-nt5lp Container created 30m Normal AddedInterface pod/maas-api-revoke-sub-2482a204-nt5lp Add eth0 [10.134.0.86/23] from ovn-kubernetes 30m Normal Pulled pod/maas-api-revoke-sub-2482a204-nt5lp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Started pod/maas-api-revoke-sub-2482a204-nt5lp Container started 30m Normal Completed job/maas-api-revoke-sub-2482a204 Job completed 30m Normal SuccessfulCreate job/maas-api-revoke-sub-d95db595 Created pod: maas-api-revoke-sub-d95db595-2jc5b 30m Normal Pulled pod/maas-api-revoke-sub-d95db595-2jc5b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-sub-d95db595-2jc5b Add eth0 [10.134.0.88/23] from ovn-kubernetes 30m Normal Created pod/maas-api-revoke-sub-d95db595-2jc5b Container created 30m Normal Started pod/maas-api-revoke-sub-d95db595-2jc5b Container started 30m Normal Completed job/maas-api-revoke-sub-d95db595 Job completed 29m Normal AddedInterface pod/maas-api-revoke-sub-1d700421-47mdl Add eth0 [10.134.0.93/23] from ovn-kubernetes 29m Normal SuccessfulCreate job/maas-api-revoke-sub-1d700421 Created pod: maas-api-revoke-sub-1d700421-47mdl 29m Normal Pulled pod/maas-api-revoke-sub-1d700421-47mdl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Started pod/maas-api-revoke-sub-1d700421-47mdl Container started 29m Normal Created pod/maas-api-revoke-sub-1d700421-47mdl Container created 29m Normal Completed job/maas-api-revoke-sub-1d700421 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-d48db09e Created pod: maas-api-revoke-sub-d48db09e-qqnwf 29m Normal Created pod/maas-api-revoke-sub-d48db09e-qqnwf Container created 29m Normal Started pod/maas-api-revoke-sub-d48db09e-qqnwf Container started 29m Normal AddedInterface pod/maas-api-revoke-sub-d48db09e-qqnwf Add eth0 [10.134.0.95/23] from ovn-kubernetes 29m Normal SuccessfulCreate job/maas-api-revoke-sub-976fb0cc Created pod: maas-api-revoke-sub-976fb0cc-sc5lm 29m Normal Pulled pod/maas-api-revoke-sub-d48db09e-qqnwf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Started pod/maas-api-revoke-sub-976fb0cc-sc5lm Container started 29m Normal Pulled pod/maas-api-revoke-sub-976fb0cc-sc5lm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-sub-976fb0cc-sc5lm Container created 29m Normal AddedInterface pod/maas-api-revoke-sub-976fb0cc-sc5lm Add eth0 [10.134.0.96/23] from ovn-kubernetes 29m Normal Completed job/maas-api-revoke-sub-d48db09e Job completed 29m Normal Completed job/maas-api-revoke-sub-976fb0cc Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-b91fa08f Created pod: maas-api-revoke-sub-b91fa08f-8h6gg 29m Normal AddedInterface pod/maas-api-revoke-sub-b91fa08f-8h6gg Add eth0 [10.134.0.101/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-sub-b91fa08f-8h6gg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal SuccessfulCreate job/maas-api-revoke-sub-b69cdb34 Created pod: maas-api-revoke-sub-b69cdb34-2zbbp 29m Normal Created pod/maas-api-revoke-sub-b91fa08f-8h6gg Container created 29m Normal Started pod/maas-api-revoke-sub-b91fa08f-8h6gg Container started 29m Normal AddedInterface pod/maas-api-revoke-sub-b69cdb34-2zbbp Add eth0 [10.134.0.102/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-sub-b69cdb34-2zbbp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-sub-b69cdb34-2zbbp Container created 29m Normal Started pod/maas-api-revoke-sub-b69cdb34-2zbbp Container started 29m Normal Completed job/maas-api-revoke-sub-b91fa08f Job completed 29m Normal Completed job/maas-api-revoke-sub-b69cdb34 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w0-648fbe Created pod: maas-api-revoke-keys-e2e-worker-w0-648fbe-xn97x 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w0-648fbe-xn97x Add eth0 [10.134.0.105/23] from ovn-kubernetes 29m Normal Created pod/maas-api-revoke-keys-e2e-worker-w0-648fbe-xn97x Container created 29m Normal Started pod/maas-api-revoke-keys-e2e-worker-w0-648fbe-xn97x Container started 29m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w0-648fbe-xn97x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Completed job/maas-api-revoke-keys-e2e-worker-w0-648fbe Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-117782a3 Created pod: maas-api-revoke-sub-117782a3-bv6xl 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w6-027d2a Created pod: maas-api-revoke-keys-e2e-worker-w6-027d2a-tmpqp 29m Normal SuccessfulCreate job/maas-api-revoke-sub-bc19f141 Created pod: maas-api-revoke-sub-bc19f141-6kzlc 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w6-027d2a-tmpqp Add eth0 [10.134.0.106/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-bc19f141-6kzlc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Created pod/maas-api-revoke-sub-117782a3-bv6xl Container created 28m Normal Pulled pod/maas-api-revoke-sub-117782a3-bv6xl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w6-027d2a-tmpqp Container started 28m Normal AddedInterface pod/maas-api-revoke-sub-117782a3-bv6xl Add eth0 [10.134.0.107/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-sub-117782a3-bv6xl Container started 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w6-027d2a-tmpqp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w6-027d2a-tmpqp Container created 28m Normal AddedInterface pod/maas-api-revoke-sub-bc19f141-6kzlc Add eth0 [10.134.0.108/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-sub-bc19f141-6kzlc Container started 28m Normal Created pod/maas-api-revoke-sub-bc19f141-6kzlc Container created 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w6-027d2a Job completed 28m Normal Completed job/maas-api-revoke-sub-117782a3 Job completed 28m Normal Completed job/maas-api-revoke-sub-bc19f141 Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-8c158eef Created pod: maas-api-revoke-sub-8c158eef-9j9pc 28m Normal Created pod/maas-api-revoke-sub-8c158eef-9j9pc Container created 28m Normal Started pod/maas-api-revoke-sub-8c158eef-9j9pc Container started 28m Normal Pulled pod/maas-api-revoke-sub-8c158eef-9j9pc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-8c158eef-9j9pc Add eth0 [10.134.0.109/23] from ovn-kubernetes 28m Normal SuccessfulCreate job/maas-api-revoke-sub-cac1558a Created pod: maas-api-revoke-sub-cac1558a-f5r5q 28m Normal Pulled pod/maas-api-revoke-sub-cac1558a-f5r5q Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Completed job/maas-api-revoke-sub-8c158eef Job completed 28m Normal AddedInterface pod/maas-api-revoke-sub-cac1558a-f5r5q Add eth0 [10.134.0.110/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-cac1558a-f5r5q Container created 28m Normal Started pod/maas-api-revoke-sub-cac1558a-f5r5q Container started 28m Normal Completed job/maas-api-revoke-sub-cac1558a Job completed 28m Normal Killing pod/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq Stopping container maas-api 28m Normal SuccessfulCreate job/maas-api-revoke-sub-6f7bf75b Created pod: maas-api-revoke-sub-6f7bf75b-nwmh2 28m Normal SuccessfulCreate job/maas-api-revoke-sub-f09760dd Created pod: maas-api-revoke-sub-f09760dd-7ltcl 28m Normal AddedInterface pod/maas-api-revoke-sub-6f7bf75b-nwmh2 Add eth0 [10.134.0.114/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-6f7bf75b-nwmh2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-sub-f09760dd-7ltcl Container started 28m Normal Created pod/maas-api-revoke-sub-f09760dd-7ltcl Container created 28m Normal Pulled pod/maas-api-revoke-sub-f09760dd-7ltcl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-f09760dd-7ltcl Add eth0 [10.134.0.113/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-6f7bf75b-nwmh2 Container created 28m Normal Started pod/maas-api-revoke-sub-6f7bf75b-nwmh2 Container started 28m Normal SuccessfulCreate job/maas-api-revoke-sub-c2b0f715 Created pod: maas-api-revoke-sub-c2b0f715-kqgr6 28m Normal Pulled pod/maas-api-revoke-sub-c2b0f715-kqgr6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-sub-c2b0f715-kqgr6 Container started 28m Normal Created pod/maas-api-revoke-sub-c2b0f715-kqgr6 Container created 28m Normal AddedInterface pod/maas-api-revoke-sub-c2b0f715-kqgr6 Add eth0 [10.134.0.116/23] from ovn-kubernetes 28m Normal Completed job/maas-api-revoke-sub-6f7bf75b Job completed 28m Normal Completed job/maas-api-revoke-sub-f09760dd Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w5-b1fda4 Created pod: maas-api-revoke-keys-e2e-worker-w5-b1fda4-6ntq5 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w5-b1fda4-6ntq5 Add eth0 [10.134.0.117/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w5-b1fda4-6ntq5 Container created 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w5-b1fda4-6ntq5 Container started 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w5-b1fda4-6ntq5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Completed job/maas-api-revoke-sub-c2b0f715 Job completed 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w5-b1fda4 Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-0b4919ba Created pod: maas-api-revoke-sub-0b4919ba-xjbhz 28m Normal Pulled pod/maas-api-revoke-sub-0b4919ba-xjbhz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-0b4919ba-xjbhz Add eth0 [10.134.0.118/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-0b4919ba-xjbhz Container created 28m Normal Started pod/maas-api-revoke-sub-0b4919ba-xjbhz Container started 28m Normal Completed job/maas-api-revoke-sub-0b4919ba Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w4-3dff3f Created pod: maas-api-revoke-keys-e2e-worker-w4-3dff3f-qkrhk 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w4-3dff3f-qkrhk Container started 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w4-3dff3f-qkrhk Container created 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w4-3dff3f-qkrhk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w4-3dff3f-qkrhk Add eth0 [10.134.0.119/23] from ovn-kubernetes 28m Normal AddedInterface pod/maas-api-revoke-sub-980d26c0-7j78w Add eth0 [10.134.0.120/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-980d26c0-7j78w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal SuccessfulCreate job/maas-api-revoke-sub-980d26c0 Created pod: maas-api-revoke-sub-980d26c0-7j78w 28m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv Add eth0 [10.134.0.121/23] from ovn-kubernetes 28m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-b1fda4 Created job maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545 28m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-3cc201 Created job maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545 28m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545 Created pod: maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd 28m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd Add eth0 [10.134.0.122/23] from ovn-kubernetes 28m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-b4e8fd Created job maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545 28m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545 Created pod: maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl 28m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl Add eth0 [10.134.0.123/23] from ovn-kubernetes 28m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-4794f5 Created job maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545 28m Normal Started pod/maas-api-revoke-sub-980d26c0-7j78w Container started 28m Normal Created pod/maas-api-revoke-sub-980d26c0-7j78w Container created 28m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545 Created pod: maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm 28m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29890545 28m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-027d2a Created job maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545 28m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Add eth0 [10.132.0.101/23] from ovn-kubernetes 28m Normal Pulling pod/maas-api-key-cleanup-29890545-jjm7v Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 28m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 28m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545 Created pod: maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw 28m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-3dff3f Created job maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545 28m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 28m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545 Created pod: maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv 28m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545 Created pod: maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 28m Normal AddedInterface pod/maas-api-key-cleanup-29890545-jjm7v Add eth0 [10.132.0.102/23] from ovn-kubernetes 28m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 Add eth0 [10.133.0.72/23] from ovn-kubernetes 28m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Add eth0 [10.132.0.100/23] from ovn-kubernetes 28m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 28m Normal SuccessfulCreate job/maas-api-key-cleanup-29890545 Created pod: maas-api-key-cleanup-29890545-jjm7v 28m Normal SuccessfulCreate job/maas-api-revoke-sub-dac3004d Created pod: maas-api-revoke-sub-dac3004d-6hnjv 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w4-3dff3f Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-e93e4474 Created pod: maas-api-revoke-sub-e93e4474-c6l5h 28m Normal Killing pod/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7 Stopping container maas-api 28m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-w6-027d2a Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-w6-027d2a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9da75efa-8706-40e2-a434-712334233719, UID in object meta: 28m Normal AddedInterface pod/maas-api-revoke-sub-dac3004d-6hnjv Add eth0 [10.132.0.103/23] from ovn-kubernetes 28m Normal Pulling pod/maas-api-revoke-sub-dac3004d-6hnjv Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 28m Normal Started pod/maas-api-revoke-sub-e93e4474-c6l5h Container started 28m Normal Created pod/maas-api-revoke-sub-e93e4474-c6l5h Container created 28m Normal Pulled pod/maas-api-revoke-sub-e93e4474-c6l5h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-e93e4474-c6l5h Add eth0 [10.134.0.124/23] from ovn-kubernetes 28m Normal Completed job/maas-api-revoke-sub-980d26c0 Job completed 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 3.572s (3.572s including waiting). Image size: 107195206 bytes. 28m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 Container started 28m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 Container created 28m Normal Pulled pod/maas-api-key-cleanup-29890545-jjm7v Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 4.92s (4.92s including waiting). Image size: 107195206 bytes. 28m Normal Pulled pod/maas-api-revoke-sub-dac3004d-6hnjv Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 3.451s (3.451s including waiting). Image size: 107195206 bytes. 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 4.933s (4.933s including waiting). Image size: 107195206 bytes. 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 5.021s (5.021s including waiting). Image size: 107195206 bytes. 28m Normal Killing pod/maas-api-key-cleanup-e2e-worker-w6-027d2a-29890545-kcsg8 Stopping container cleanup 28m Normal Completed job/maas-api-revoke-sub-e93e4474 Job completed 28m Normal Started pod/maas-api-revoke-sub-dac3004d-6hnjv Container started 28m Normal Created pod/maas-api-revoke-sub-dac3004d-6hnjv Container created 28m Normal Completed job/maas-api-revoke-sub-dac3004d Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-4ffdd5d6 Created pod: maas-api-revoke-sub-4ffdd5d6-wwz4g 28m Normal AddedInterface pod/maas-api-revoke-sub-4ffdd5d6-wwz4g Add eth0 [10.134.0.125/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-4ffdd5d6-wwz4g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w3-3cc201 Created pod: maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82 Add eth0 [10.132.0.104/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-sub-4ffdd5d6-wwz4g Container started 28m Normal Created pod/maas-api-revoke-sub-4ffdd5d6-wwz4g Container created 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82 Container created 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82 Container started 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Pulled pod/maas-api-revoke-sub-fb31e973-44vn2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w3-3cc201 Job completed 28m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv Container created 28m Normal Pulled pod/maas-api-revoke-sub-7dd675ee-v2q49 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-7dd675ee-v2q49 Add eth0 [10.134.0.126/23] from ovn-kubernetes 28m Normal Completed job/maas-api-revoke-sub-4ffdd5d6 Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-fb31e973 Created pod: maas-api-revoke-sub-fb31e973-44vn2 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv Container started 28m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl Container started 28m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl Container created 28m Normal AddedInterface pod/maas-api-revoke-sub-fb31e973-44vn2 Add eth0 [10.132.0.105/23] from ovn-kubernetes 28m Normal SuccessfulCreate job/maas-api-revoke-sub-7dd675ee Created pod: maas-api-revoke-sub-7dd675ee-v2q49 28m Normal Started pod/maas-api-revoke-sub-fb31e973-44vn2 Container started 28m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl_odh-ai-gateway-infra(8965a35f-4b30-4e02-b22f-62634ae83b31) 28m Normal Created pod/maas-api-revoke-sub-7dd675ee-v2q49 Container created 28m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv_odh-ai-gateway-infra(d35962de-8dfc-477e-aebe-c0fb2ec68e5e) 28m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-b1fda4-29890545-vlfjv 28m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd Container started 28m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd Container created 28m Normal Started pod/maas-api-revoke-sub-7dd675ee-v2q49 Container started 28m Normal Created pod/maas-api-revoke-sub-fb31e973-44vn2 Container created 28m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545-vsvzl 28m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd 28m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545-fthgd_odh-ai-gateway-infra(993617de-c2f4-4f68-899b-f4cd1b192429) 28m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545 Job has reached the specified backoff limit 28m Normal Killing pod/maas-api-e2e-worker-w5-b1fda4-6cfb47bc4-ktffp Stopping container maas-api 28m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-b4e8fd Saw completed job: maas-api-key-cleanup-e2e-worker-w2-b4e8fd-29890545, condition: Failed 28m Normal Pulled pod/maas-api-key-cleanup-29890545-jjm7v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Completed job/maas-api-revoke-sub-fb31e973 Job completed 28m Normal Completed job/maas-api-revoke-sub-7dd675ee Job completed 28m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545 Job has reached the specified backoff limit 28m Normal Created pod/maas-api-key-cleanup-29890545-jjm7v Container created 28m Normal Started pod/maas-api-key-cleanup-29890545-jjm7v Container started 28m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-3cc201 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-3cc201-29890545, condition: Failed 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal SuccessfulDelete job/maas-api-key-cleanup-29890545 Deleted pod: maas-api-key-cleanup-29890545-jjm7v 28m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Warning BackOff pod/maas-api-key-cleanup-29890545-jjm7v Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29890545-jjm7v_odh-ai-gateway-infra(f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da) 28m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Container created 28m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Container created 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w1-4794f5 Created pod: maas-api-revoke-keys-e2e-worker-w1-4794f5-fxvb2 28m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Container started 27m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm_odh-ai-gateway-infra(5768b5e5-af88-42c7-8784-057cc0280a2b) 27m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29890545, condition: Failed 27m Normal SuccessfulCreate job/maas-api-revoke-sub-3061197b Created pod: maas-api-revoke-sub-3061197b-7fwnq 27m Normal SuccessfulCreate job/maas-api-revoke-sub-3687bccb Created pod: maas-api-revoke-sub-3687bccb-9rqzs 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w1-4794f5-fxvb2 Add eth0 [10.134.0.129/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w1-4794f5-fxvb2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-keys-e2e-worker-w1-4794f5-fxvb2 Container created 27m Normal Started pod/maas-api-revoke-keys-e2e-worker-w1-4794f5-fxvb2 Container started 27m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Container started 27m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29890545 Job has reached the specified backoff limit 27m Normal AddedInterface pod/maas-api-revoke-sub-3061197b-7fwnq Add eth0 [10.134.0.131/23] from ovn-kubernetes 27m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm 27m Normal AddedInterface pod/maas-api-revoke-sub-3687bccb-9rqzs Add eth0 [10.134.0.130/23] from ovn-kubernetes 27m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw 27m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw_odh-ai-gateway-infra(50bdd918-5e8c-4701-b088-e29fce34b180) 27m Normal Pulled pod/maas-api-revoke-sub-3061197b-7fwnq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Pulled pod/maas-api-revoke-sub-3687bccb-9rqzs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-sub-3687bccb-9rqzs Container created 27m Normal Started pod/maas-api-revoke-sub-3687bccb-9rqzs Container started 27m Normal Created pod/maas-api-revoke-sub-3061197b-7fwnq Container created 27m Normal Started pod/maas-api-revoke-sub-3061197b-7fwnq Container started 27m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545 Job has reached the specified backoff limit 27m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-4794f5 Saw completed job: maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545, condition: Failed 27m Normal Completed job/maas-api-revoke-keys-e2e-worker-w1-4794f5 Job completed 27m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-3dff3f Saw completed job: maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545, condition: Failed 27m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545 Job has reached the specified backoff limit 27m Normal Completed job/maas-api-revoke-sub-3687bccb Job completed 27m Normal Completed job/maas-api-revoke-sub-3061197b Job completed 27m Normal Killing pod/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8 Stopping container maas-api 27m Normal Killing pod/maas-api-e2e-worker-w3-3cc201-794db477f8-8hbtd Stopping container maas-api 27m Normal SuccessfulCreate job/maas-api-revoke-sub-a131f47a Created pod: maas-api-revoke-sub-a131f47a-mltx2 27m Normal SuccessfulCreate job/maas-api-revoke-sub-d1f09f4c Created pod: maas-api-revoke-sub-d1f09f4c-wwqt4 27m Normal Started pod/maas-api-revoke-sub-d1f09f4c-wwqt4 Container started 27m Normal SuccessfulCreate job/maas-api-revoke-sub-f48b9cf3 Created pod: maas-api-revoke-sub-f48b9cf3-z9vq4 27m Normal Started pod/maas-api-revoke-sub-a131f47a-mltx2 Container started 27m Normal Created pod/maas-api-revoke-sub-a131f47a-mltx2 Container created 27m Normal AddedInterface pod/maas-api-revoke-sub-f48b9cf3-z9vq4 Add eth0 [10.132.0.110/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-sub-f48b9cf3-z9vq4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Pulled pod/maas-api-revoke-sub-a131f47a-mltx2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-sub-a131f47a-mltx2 Add eth0 [10.132.0.109/23] from ovn-kubernetes 27m Normal Created pod/maas-api-revoke-sub-d1f09f4c-wwqt4 Container created 27m Normal Pulled pod/maas-api-revoke-sub-d1f09f4c-wwqt4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-sub-d1f09f4c-wwqt4 Add eth0 [10.134.0.132/23] from ovn-kubernetes 27m Normal Started pod/maas-api-revoke-sub-f48b9cf3-z9vq4 Container started 27m Normal Created pod/maas-api-revoke-sub-f48b9cf3-z9vq4 Container created 27m Normal Completed job/maas-api-revoke-sub-d1f09f4c Job completed 27m Normal Completed job/maas-api-revoke-sub-a131f47a Job completed 27m Normal Completed job/maas-api-revoke-sub-f48b9cf3 Job completed 27m Normal AddedInterface pod/maas-api-revoke-sub-31de0bd4-jnnnm Add eth0 [10.132.0.111/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-sub-31de0bd4-jnnnm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal SuccessfulCreate job/maas-api-revoke-sub-31de0bd4 Created pod: maas-api-revoke-sub-31de0bd4-jnnnm 27m Normal Created pod/maas-api-revoke-sub-31de0bd4-jnnnm Container created 27m Normal Started pod/maas-api-revoke-sub-31de0bd4-jnnnm Container started 27m Normal Completed job/maas-api-revoke-sub-31de0bd4 Job completed 27m Normal Killing pod/maas-api-e2e-worker-w1-4794f5-85f66f7bf-vpxzr Stopping container maas-api 27m Normal Started pod/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47 Container started 27m Normal Created pod/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47 Container created 27m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47 Add eth0 [10.132.0.112/23] from ovn-kubernetes 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w2-b4e8fd Created pod: maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47 27m Normal Completed job/maas-api-revoke-keys-e2e-worker-w2-b4e8fd Job completed 27m Normal SuccessfulCreate job/maas-api-revoke-sub-091c1d6e Created pod: maas-api-revoke-sub-091c1d6e-cb4bs 27m Normal SuccessfulCreate job/maas-api-revoke-sub-6ac71db4 Created pod: maas-api-revoke-sub-6ac71db4-k924w 27m Normal Started pod/maas-api-revoke-sub-6ac71db4-k924w Container started 27m Normal Started pod/maas-api-revoke-sub-091c1d6e-cb4bs Container started 27m Normal AddedInterface pod/maas-api-revoke-sub-6ac71db4-k924w Add eth0 [10.134.0.133/23] from ovn-kubernetes 27m Normal Created pod/maas-api-revoke-sub-6ac71db4-k924w Container created 27m Normal AddedInterface pod/maas-api-revoke-sub-091c1d6e-cb4bs Add eth0 [10.132.0.113/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-sub-6ac71db4-k924w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Pulled pod/maas-api-revoke-sub-091c1d6e-cb4bs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-sub-091c1d6e-cb4bs Container created 27m Normal Completed job/maas-api-revoke-sub-091c1d6e Job completed 27m Normal Completed job/maas-api-revoke-sub-6ac71db4 Job completed 26m Normal Killing pod/maas-api-e2e-worker-w2-b4e8fd-6bf66f4598-bh6jm Stopping container maas-api 26m Normal SuccessfulCreate job/maas-api-revoke-sub-85237e45 Created pod: maas-api-revoke-sub-85237e45-klg8z 26m Normal AddedInterface pod/maas-api-revoke-sub-85237e45-klg8z Add eth0 [10.132.0.114/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-85237e45-klg8z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-sub-85237e45-klg8z Container created 26m Normal Started pod/maas-api-revoke-sub-85237e45-klg8z Container started 26m Normal Completed job/maas-api-revoke-sub-85237e45 Job completed 25m Normal SuccessfulCreate job/maas-api-revoke-sub-c1e271a9 Created pod: maas-api-revoke-sub-c1e271a9-6fnpr 25m Normal AddedInterface pod/maas-api-revoke-sub-c1e271a9-6fnpr Add eth0 [10.132.0.115/23] from ovn-kubernetes 25m Normal Created pod/maas-api-revoke-sub-c1e271a9-6fnpr Container created 25m Normal Pulled pod/maas-api-revoke-sub-c1e271a9-6fnpr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Started pod/maas-api-revoke-sub-c1e271a9-6fnpr Container started 25m Normal Completed job/maas-api-revoke-sub-c1e271a9 Job completed 24m Normal AddedInterface pod/maas-api-revoke-sub-2e1f5b5f-vxzlr Add eth0 [10.132.0.116/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-sub-2e1f5b5f-vxzlr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal SuccessfulCreate job/maas-api-revoke-sub-2e1f5b5f Created pod: maas-api-revoke-sub-2e1f5b5f-vxzlr 24m Normal Created pod/maas-api-revoke-sub-2e1f5b5f-vxzlr Container created 24m Normal Started pod/maas-api-revoke-sub-2e1f5b5f-vxzlr Container started 24m Normal Completed job/maas-api-revoke-sub-2e1f5b5f Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-ec843018 Created pod: maas-api-revoke-sub-ec843018-szqzd 24m Normal Created pod/maas-api-revoke-sub-ec843018-szqzd Container created 24m Normal Started pod/maas-api-revoke-sub-ec843018-szqzd Container started 24m Normal Pulled pod/maas-api-revoke-sub-ec843018-szqzd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal AddedInterface pod/maas-api-revoke-sub-ec843018-szqzd Add eth0 [10.132.0.117/23] from ovn-kubernetes 24m Normal Completed job/maas-api-revoke-sub-ec843018 Job completed 23m Normal AddedInterface pod/maas-api-revoke-sub-046e1343-p49k5 Add eth0 [10.132.0.118/23] from ovn-kubernetes 23m Normal SuccessfulCreate job/maas-api-revoke-sub-046e1343 Created pod: maas-api-revoke-sub-046e1343-p49k5 23m Normal Pulled pod/maas-api-revoke-sub-046e1343-p49k5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Started pod/maas-api-revoke-sub-046e1343-p49k5 Container started 23m Normal Created pod/maas-api-revoke-sub-046e1343-p49k5 Container created 23m Normal Completed job/maas-api-revoke-sub-046e1343 Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-d3fba056 Created pod: maas-api-revoke-sub-d3fba056-46xh5 23m Normal Started pod/maas-api-revoke-sub-d3fba056-46xh5 Container started 23m Normal Created pod/maas-api-revoke-sub-d3fba056-46xh5 Container created 23m Normal AddedInterface pod/maas-api-revoke-sub-d3fba056-46xh5 Add eth0 [10.132.0.119/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-d3fba056-46xh5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Completed job/maas-api-revoke-sub-d3fba056 Job completed 23m Normal Pulled pod/maas-api-revoke-sub-ae594979-m2558 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-sub-ae594979-m2558 Add eth0 [10.132.0.120/23] from ovn-kubernetes 23m Normal SuccessfulCreate job/maas-api-revoke-sub-ae594979 Created pod: maas-api-revoke-sub-ae594979-m2558 23m Normal Created pod/maas-api-revoke-sub-ae594979-m2558 Container created 23m Normal Started pod/maas-api-revoke-sub-ae594979-m2558 Container started 23m Normal Completed job/maas-api-revoke-sub-ae594979 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-a4aef7d7 Created pod: maas-api-revoke-sub-a4aef7d7-2jfwt 22m Normal Created pod/maas-api-revoke-sub-a4aef7d7-2jfwt Container created 22m Normal Started pod/maas-api-revoke-sub-a4aef7d7-2jfwt Container started 22m Normal AddedInterface pod/maas-api-revoke-sub-a4aef7d7-2jfwt Add eth0 [10.132.0.121/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-a4aef7d7-2jfwt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Completed job/maas-api-revoke-sub-a4aef7d7 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-79805ca9 Created pod: maas-api-revoke-sub-79805ca9-gh6jn 22m Normal Pulled pod/maas-api-revoke-sub-79805ca9-gh6jn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-sub-79805ca9-gh6jn Add eth0 [10.132.0.122/23] from ovn-kubernetes 22m Normal Created pod/maas-api-revoke-sub-79805ca9-gh6jn Container created 22m Normal Started pod/maas-api-revoke-sub-79805ca9-gh6jn Container started 22m Normal Completed job/maas-api-revoke-sub-79805ca9 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-0b7e8edb Created pod: maas-api-revoke-sub-0b7e8edb-7chr9 22m Normal Pulled pod/maas-api-revoke-sub-0b7e8edb-7chr9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-sub-0b7e8edb-7chr9 Add eth0 [10.134.0.134/23] from ovn-kubernetes 22m Normal Started pod/maas-api-revoke-sub-0b7e8edb-7chr9 Container started 22m Normal Created pod/maas-api-revoke-sub-0b7e8edb-7chr9 Container created 22m Normal Completed job/maas-api-revoke-sub-0b7e8edb Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-5g999 21m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-5g999 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-sub-3d4156f1-5g999 Container created 21m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-5g999 Add eth0 [10.134.0.135/23] from ovn-kubernetes 21m Normal Started pod/maas-api-revoke-sub-3d4156f1-5g999 Container started 21m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-fppgp 21m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-fppgp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Started pod/maas-api-revoke-sub-3d4156f1-fppgp Container started 21m Normal Created pod/maas-api-revoke-sub-3d4156f1-fppgp Container created 21m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-fppgp Add eth0 [10.134.0.136/23] from ovn-kubernetes 21m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 20m Normal SuccessfulCreate job/maas-api-revoke-sub-e2fc9c5b Created pod: maas-api-revoke-sub-e2fc9c5b-244lv 20m Normal Pulled pod/maas-api-revoke-sub-e2fc9c5b-244lv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-sub-e2fc9c5b-244lv Add eth0 [10.134.0.137/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-sub-e2fc9c5b-244lv Container started 20m Normal Created pod/maas-api-revoke-sub-e2fc9c5b-244lv Container created 20m Normal Completed job/maas-api-revoke-sub-e2fc9c5b Job completed 20m Normal SuccessfulCreate job/maas-api-revoke-sub-5a29efb3 Created pod: maas-api-revoke-sub-5a29efb3-r5xh6 20m Normal Started pod/maas-api-revoke-sub-5a29efb3-r5xh6 Container started 20m Normal Created pod/maas-api-revoke-sub-5a29efb3-r5xh6 Container created 20m Normal Pulled pod/maas-api-revoke-sub-5a29efb3-r5xh6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-sub-5a29efb3-r5xh6 Add eth0 [10.134.0.138/23] from ovn-kubernetes 20m Normal Completed job/maas-api-revoke-sub-5a29efb3 Job completed 20m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-5mg6p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-5mg6p 20m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-5mg6p Add eth0 [10.134.0.139/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-sub-3d4156f1-5mg6p Container started 20m Normal Created pod/maas-api-revoke-sub-3d4156f1-5mg6p Container created 19m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 19m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-009b0f Scaled up replica set maas-api-e2e-worker-single-main-009b0f-fb4c466c9 from 0 to 1 19m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-009b0f-fb4c466c9 Created pod: maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm 19m Normal Pulling pod/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 19m Normal AddedInterface pod/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm Add eth0 [10.133.0.77/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 525ms (525ms including waiting). Image size: 194581366 bytes. 19m Normal Started pod/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm Container started 19m Normal Created pod/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm Container created 18m Normal SuccessfulCreate job/maas-api-revoke-sub-e8ab697c Created pod: maas-api-revoke-sub-e8ab697c-jlkkn 18m Normal AddedInterface pod/maas-api-revoke-sub-e8ab697c-jlkkn Add eth0 [10.134.0.142/23] from ovn-kubernetes 18m Normal Started pod/maas-api-revoke-sub-e8ab697c-jlkkn Container started 18m Normal Created pod/maas-api-revoke-sub-e8ab697c-jlkkn Container created 18m Normal Pulled pod/maas-api-revoke-sub-e8ab697c-jlkkn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Completed job/maas-api-revoke-sub-e8ab697c Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-009b0f Created pod: maas-api-revoke-keys-e2e-worker-single-main-009b0f-gc7df 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-009b0f-gc7df Add eth0 [10.134.0.143/23] from ovn-kubernetes 18m Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-009b0f-gc7df Container created 18m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-009b0f-gc7df Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-009b0f-gc7df Container started 18m Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-009b0f Job completed 18m Normal Killing pod/maas-api-e2e-worker-single-main-009b0f-fb4c466c9-l9hhm Stopping container maas-api 17m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-sftn4 17m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-sftn4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Created pod/maas-api-revoke-sub-3d4156f1-sftn4 Container created 17m Normal Started pod/maas-api-revoke-sub-3d4156f1-sftn4 Container started 17m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-sftn4 Add eth0 [10.134.0.144/23] from ovn-kubernetes 17m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 15m Normal SuccessfulCreate job/maas-api-revoke-sub-d576e68b Created pod: maas-api-revoke-sub-d576e68b-9xzhh 15m Normal Started pod/maas-api-revoke-sub-d576e68b-9xzhh Container started 15m Normal Created pod/maas-api-revoke-sub-d576e68b-9xzhh Container created 15m Normal Pulled pod/maas-api-revoke-sub-d576e68b-9xzhh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-sub-d576e68b-9xzhh Add eth0 [10.134.0.145/23] from ovn-kubernetes 15m Normal Completed job/maas-api-revoke-sub-d576e68b Job completed 15m Normal SuccessfulCreate job/maas-api-revoke-sub-d2bc93bc Created pod: maas-api-revoke-sub-d2bc93bc-g7tm9 15m Normal Pulled pod/maas-api-revoke-sub-d2bc93bc-g7tm9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-sub-d2bc93bc-g7tm9 Add eth0 [10.134.0.146/23] from ovn-kubernetes 15m Normal Created pod/maas-api-revoke-sub-d2bc93bc-g7tm9 Container created 15m Normal Started pod/maas-api-revoke-sub-d2bc93bc-g7tm9 Container started 14m Normal Completed job/maas-api-revoke-sub-d2bc93bc Job completed 14m Normal AddedInterface pod/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc Add eth0 [10.133.0.80/23] from ovn-kubernetes 14m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9 Created pod: maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc 14m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-11a81e Scaled up replica set maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9 from 0 to 1 14m Normal Started pod/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc Container started 14m Normal Created pod/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc Container created 14m Normal Pulled pod/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 402ms (402ms including waiting). Image size: 194581366 bytes. 14m Normal Pulling pod/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 14m Normal AddedInterface pod/maas-api-revoke-sub-ef47abfe-h4hhq Add eth0 [10.134.0.149/23] from ovn-kubernetes 14m Normal Pulled pod/maas-api-revoke-sub-ef47abfe-h4hhq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal SuccessfulCreate job/maas-api-revoke-sub-ef47abfe Created pod: maas-api-revoke-sub-ef47abfe-h4hhq 14m Normal Created pod/maas-api-revoke-sub-ef47abfe-h4hhq Container created 14m Normal Started pod/maas-api-revoke-sub-ef47abfe-h4hhq Container started 13m Normal Completed job/maas-api-revoke-sub-ef47abfe Job completed 13m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-11a81e-pw4w7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-11a81e-pw4w7 Add eth0 [10.134.0.150/23] from ovn-kubernetes 13m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-11a81e Created pod: maas-api-revoke-keys-e2e-worker-single-main-11a81e-pw4w7 13m Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-11a81e-pw4w7 Container created 13m Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-11a81e-pw4w7 Container started 13m Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-11a81e Job completed 13m Normal Killing pod/maas-api-e2e-worker-single-main-11a81e-f5bcb9dc9-nw4qc Stopping container maas-api 13m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-single-main-11a81e Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-single-main-11a81e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11a81e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 16941488-f285-4650-a033-2bb4c60c857a, UID in object meta: 13m Normal SuccessfulCreate job/maas-api-key-cleanup-29890560 Created pod: maas-api-key-cleanup-29890560-vjqrf 13m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29890560 13m Normal AddedInterface pod/maas-api-key-cleanup-29890560-vjqrf Add eth0 [10.134.0.151/23] from ovn-kubernetes 13m Normal Pulled pod/maas-api-key-cleanup-29890560-vjqrf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal Started pod/maas-api-key-cleanup-29890560-vjqrf Container started 13m Normal Created pod/maas-api-key-cleanup-29890560-vjqrf Container created 13m Warning BackOff pod/maas-api-key-cleanup-29890560-vjqrf Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29890560-vjqrf_odh-ai-gateway-infra(e7544fbc-ef1f-458b-a5e9-e588ca8cf34d) 13m Normal SuccessfulDelete job/maas-api-key-cleanup-29890560 Deleted pod: maas-api-key-cleanup-29890560-vjqrf 13m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29890560, condition: Failed 13m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29890560 Job has reached the specified backoff limit 12m Normal SuccessfulCreate job/maas-api-revoke-sub-452b6d7b Created pod: maas-api-revoke-sub-452b6d7b-k46ml 12m Normal Pulled pod/maas-api-revoke-sub-452b6d7b-k46ml Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal Created pod/maas-api-revoke-sub-452b6d7b-k46ml Container created 12m Normal Started pod/maas-api-revoke-sub-452b6d7b-k46ml Container started 12m Normal AddedInterface pod/maas-api-revoke-sub-452b6d7b-k46ml Add eth0 [10.134.0.152/23] from ovn-kubernetes 12m Normal Completed job/maas-api-revoke-sub-452b6d7b Job completed 11m Normal SuccessfulCreate job/maas-api-revoke-sub-3e31a506 Created pod: maas-api-revoke-sub-3e31a506-hpqcq 11m Normal Created pod/maas-api-revoke-sub-3e31a506-hpqcq Container created 11m Normal Started pod/maas-api-revoke-sub-3e31a506-hpqcq Container started 11m Normal Pulled pod/maas-api-revoke-sub-3e31a506-hpqcq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal AddedInterface pod/maas-api-revoke-sub-3e31a506-hpqcq Add eth0 [10.134.0.153/23] from ovn-kubernetes 11m Normal Completed job/maas-api-revoke-sub-3e31a506 Job completed 11m Normal SuccessfulCreate job/maas-api-revoke-sub-157e87f5 Created pod: maas-api-revoke-sub-157e87f5-2jtd9 11m Normal AddedInterface pod/maas-api-revoke-sub-157e87f5-2jtd9 Add eth0 [10.134.0.154/23] from ovn-kubernetes 11m Normal Pulled pod/maas-api-revoke-sub-157e87f5-2jtd9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal Created pod/maas-api-revoke-sub-157e87f5-2jtd9 Container created 11m Normal Started pod/maas-api-revoke-sub-157e87f5-2jtd9 Container started 11m Normal Completed job/maas-api-revoke-sub-157e87f5 Job completed 10m Normal Pulling pod/maas-api-79fc8bc9c5-fn6ck Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal Pulling pod/maas-api-f4d8b9659-rbhwr Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal SuccessfulCreate replicaset/maas-api-f4d8b9659 Created pod: maas-api-f4d8b9659-rbhwr 10m Normal AddedInterface pod/maas-api-f4d8b9659-rbhwr Add eth0 [10.133.0.81/23] from ovn-kubernetes 10m Normal SuccessfulCreate replicaset/maas-api-79fc8bc9c5 Created pod: maas-api-79fc8bc9c5-fn6ck 10m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-79fc8bc9c5 from 1 to 2 10m Normal AddedInterface pod/maas-api-79fc8bc9c5-fn6ck Add eth0 [10.132.0.127/23] from ovn-kubernetes 10m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-f4d8b9659 from 0 to 1 10m Normal Created pod/maas-api-f4d8b9659-rbhwr Container created 10m Normal Pulled pod/maas-api-79fc8bc9c5-fn6ck Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 409ms (409ms including waiting). Image size: 194581366 bytes. 10m Normal Created pod/maas-api-79fc8bc9c5-fn6ck Container created 10m Normal Pulled pod/maas-api-f4d8b9659-rbhwr Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 375ms (375ms including waiting). Image size: 194581366 bytes. 10m Normal Started pod/maas-api-f4d8b9659-rbhwr Container started 10m Normal Started pod/maas-api-79fc8bc9c5-fn6ck Container started 10m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-79fc8bc9c5 from 2 to 1 10m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-f4d8b9659 from 1 to 2 10m Normal SuccessfulDelete replicaset/maas-api-79fc8bc9c5 Deleted pod: maas-api-79fc8bc9c5-fn6ck 10m Warning Unhealthy pod/maas-api-79fc8bc9c5-fn6ck Readiness probe failed: Get "https://10.132.0.127:8443/health": dial tcp 10.132.0.127:8443: connect: connection refused 10m Normal Killing pod/maas-api-79fc8bc9c5-fn6ck Stopping container maas-api 10m Normal SuccessfulCreate replicaset/maas-api-f4d8b9659 Created pod: maas-api-f4d8b9659-ncxh7 10m Normal Created pod/maas-api-f4d8b9659-ncxh7 Container created 10m Normal Started pod/maas-api-f4d8b9659-ncxh7 Container started 10m Normal AddedInterface pod/maas-api-f4d8b9659-ncxh7 Add eth0 [10.132.0.128/23] from ovn-kubernetes 10m Normal Pulling pod/maas-api-f4d8b9659-ncxh7 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal Pulled pod/maas-api-f4d8b9659-ncxh7 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 320ms (320ms including waiting). Image size: 194581366 bytes. 10m Normal Killing pod/maas-api-79fc8bc9c5-jdz9r Stopping container maas-api 10m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-79fc8bc9c5 from 1 to 0 10m Normal SuccessfulDelete replicaset/maas-api-79fc8bc9c5 Deleted pod: maas-api-79fc8bc9c5-jdz9r 10m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-fd18eeb3 Scaled up replica set maas-api-e2e-ait-fd18eeb3-749fffbf6c from 0 to 1 10m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-fd18eeb3-749fffbf6c Created pod: maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f 10m Warning FailedMount pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-fd18eeb3-serving-cert" not found 10m Normal Pulling pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal Created pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f Container created 10m Normal Started pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f Container started 10m Normal Pulled pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 316ms (316ms including waiting). Image size: 194581366 bytes. 10m Normal AddedInterface pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f Add eth0 [10.133.0.83/23] from ovn-kubernetes 10m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-fd18eeb3 Created pod: maas-api-revoke-keys-e2e-ait-fd18eeb3-fdg87 10m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-fd18eeb3-fdg87 Add eth0 [10.134.0.157/23] from ovn-kubernetes 10m Normal Started pod/maas-api-revoke-keys-e2e-ait-fd18eeb3-fdg87 Container started 10m Normal Created pod/maas-api-revoke-keys-e2e-ait-fd18eeb3-fdg87 Container created 10m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-fd18eeb3-fdg87 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal Completed job/maas-api-revoke-keys-e2e-ait-fd18eeb3 Job completed 9m52s Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ait-fd18eeb3 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3: Operation cannot be fulfilled on endpoints "maas-api-e2e-ait-fd18eeb3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ait-fd18eeb3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a019af82-1a2c-46b7-96c0-4cf5a00ecf49, UID in object meta: 9m52s Normal Killing pod/maas-api-e2e-ait-fd18eeb3-749fffbf6c-82g8f Stopping container maas-api 9m13s Normal ScalingReplicaSet deployment/maas-api-e2e-authcfg-http-0503df Scaled up replica set maas-api-e2e-authcfg-http-0503df-64988b95d4 from 0 to 1 9m13s Normal SuccessfulCreate replicaset/maas-api-e2e-authcfg-http-0503df-64988b95d4 Created pod: maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb 9m12s Normal AddedInterface pod/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb Add eth0 [10.133.0.84/23] from ovn-kubernetes 9m12s Normal Pulling pod/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 9m11s Normal Pulled pod/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 448ms (448ms including waiting). Image size: 194581366 bytes. 9m11s Normal Created pod/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb Container created 9m11s Normal Started pod/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb Container started 7m39s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-authcfg-http-0503df Created pod: maas-api-revoke-keys-e2e-authcfg-http-0503df-5hvgt 7m38s Normal AddedInterface pod/maas-api-revoke-keys-e2e-authcfg-http-0503df-5hvgt Add eth0 [10.134.0.161/23] from ovn-kubernetes 7m38s Normal Pulled pod/maas-api-revoke-keys-e2e-authcfg-http-0503df-5hvgt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 7m38s Normal Created pod/maas-api-revoke-keys-e2e-authcfg-http-0503df-5hvgt Container created 7m38s Normal Started pod/maas-api-revoke-keys-e2e-authcfg-http-0503df-5hvgt Container started 7m34s Normal Completed job/maas-api-revoke-keys-e2e-authcfg-http-0503df Job completed 7m23s Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-authcfg-http-0503df Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df: Operation cannot be fulfilled on endpoints "maas-api-e2e-authcfg-http-0503df": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0503df, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f7c111aa-3ec7-462b-82c9-56c0e0edcbe5, UID in object meta: 7m23s Normal Killing pod/maas-api-e2e-authcfg-http-0503df-64988b95d4-mdlqb Stopping container maas-api 6m48s Normal SuccessfulCreate job/maas-api-revoke-sub-f03629db Created pod: maas-api-revoke-sub-f03629db-p4t2z 6m47s Normal AddedInterface pod/maas-api-revoke-sub-f03629db-p4t2z Add eth0 [10.134.0.162/23] from ovn-kubernetes 6m47s Normal Created pod/maas-api-revoke-sub-f03629db-p4t2z Container created 6m47s Normal Started pod/maas-api-revoke-sub-f03629db-p4t2z Container started 6m47s Normal Pulled pod/maas-api-revoke-sub-f03629db-p4t2z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 6m44s Normal Completed job/maas-api-revoke-sub-f03629db Job completed 6m22s Normal SuccessfulCreate job/maas-api-revoke-sub-0165d7d2 Created pod: maas-api-revoke-sub-0165d7d2-z9vwr 6m22s Normal Pulled pod/maas-api-revoke-sub-0165d7d2-z9vwr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 6m22s Normal AddedInterface pod/maas-api-revoke-sub-0165d7d2-z9vwr Add eth0 [10.134.0.163/23] from ovn-kubernetes 6m21s Normal Started pod/maas-api-revoke-sub-0165d7d2-z9vwr Container started 6m21s Normal Created pod/maas-api-revoke-sub-0165d7d2-z9vwr Container created 6m18s Normal Completed job/maas-api-revoke-sub-0165d7d2 Job completed 6m11s Normal SuccessfulCreate job/maas-api-revoke-sub-6b19338f Created pod: maas-api-revoke-sub-6b19338f-nfrp9 6m11s Normal AddedInterface pod/maas-api-revoke-sub-6b19338f-nfrp9 Add eth0 [10.134.0.164/23] from ovn-kubernetes 6m11s Normal Pulled pod/maas-api-revoke-sub-6b19338f-nfrp9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 6m10s Normal Started pod/maas-api-revoke-sub-6b19338f-nfrp9 Container started 6m10s Normal Created pod/maas-api-revoke-sub-6b19338f-nfrp9 Container created 6m7s Normal Completed job/maas-api-revoke-sub-6b19338f Job completed