=== events in odh-ai-gateway-infra (2026-10-31T18:23:19Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 34m Normal Scheduled pod/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h to ip-10-0-142-138.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-e8f06945-xm42k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e8f06945-xm42k to ip-10-0-138-123.ec2.internal 13m Normal Scheduled pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q to ip-10-0-142-138.ec2.internal 18m Normal Scheduled pod/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 to ip-10-0-142-138.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w5-e2e897-pfhwn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-e2e897-pfhwn to ip-10-0-138-123.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-ddf29834-fgm24 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ddf29834-fgm24 to ip-10-0-138-123.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-837afa08-9td2z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-837afa08-9td2z to ip-10-0-138-123.ec2.internal 10m Normal Scheduled pod/maas-api-58c87df8db-qp7ps Successfully assigned odh-ai-gateway-infra/maas-api-58c87df8db-qp7ps to ip-10-0-140-192.ec2.internal 45m Normal Scheduled pod/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 to ip-10-0-142-138.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w6-5d73b9-crdg9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-5d73b9-crdg9 to ip-10-0-140-192.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 to ip-10-0-140-192.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-dc109b46-p4zq2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-dc109b46-p4zq2 to ip-10-0-138-123.ec2.internal 57m Normal Scheduled pod/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 to ip-10-0-142-138.ec2.internal 6m59s Normal Scheduled pod/maas-api-revoke-sub-0165d7d2-4b58h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-4b58h to ip-10-0-138-123.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-81828ed1-xbjjx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-81828ed1-xbjjx to ip-10-0-140-192.ec2.internal 61m Normal Scheduled pod/postgres-7cdbf6dc44-5cvwx Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-5cvwx to ip-10-0-140-192.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-7fae8d51-slbd9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7fae8d51-slbd9 to ip-10-0-138-123.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c to ip-10-0-142-138.ec2.internal 60m Normal Scheduled pod/maas-api-6d669c7fcd-rsv7h Successfully assigned odh-ai-gateway-infra/maas-api-6d669c7fcd-rsv7h to ip-10-0-140-192.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-e2fc9c5b-6rlpt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e2fc9c5b-6rlpt to ip-10-0-140-192.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-046e1343-7t7mv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-7t7mv to ip-10-0-140-192.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-7e25e985-hf8xg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7e25e985-hf8xg to ip-10-0-138-123.ec2.internal 44m Normal Scheduled pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw to ip-10-0-142-138.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-e812571d-9tq2v Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e812571d-9tq2v to ip-10-0-138-123.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-0b7e8edb-2j575 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-2j575 to ip-10-0-140-192.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-79ce2fd4-fb9m9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79ce2fd4-fb9m9 to ip-10-0-138-123.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 to ip-10-0-140-192.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-79805ca9-5477h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-5477h to ip-10-0-140-192.ec2.internal 10m Normal Scheduled pod/maas-api-77b4f5466-46jwt Successfully assigned odh-ai-gateway-infra/maas-api-77b4f5466-46jwt to ip-10-0-142-138.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-6ff20e72-gpqlm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6ff20e72-gpqlm to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-ff16e334-6rh5x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ff16e334-6rh5x to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p to ip-10-0-140-192.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk to ip-10-0-138-123.ec2.internal 10m Normal Scheduled pod/maas-api-77b4f5466-tlq6k Successfully assigned odh-ai-gateway-infra/maas-api-77b4f5466-tlq6k to ip-10-0-140-192.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn to ip-10-0-138-123.ec2.internal 35m Normal Scheduled pod/maas-api-revoke-sub-d16ca106-w5gwn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d16ca106-w5gwn to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-fb23aebc-644jd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fb23aebc-644jd to ip-10-0-138-123.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-42dad67e-zcdx6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-42dad67e-zcdx6 to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg to ip-10-0-140-192.ec2.internal 49m Normal Scheduled pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 to ip-10-0-140-192.ec2.internal 47m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-5d6f1188-2c7wb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5d6f1188-2c7wb to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f to ip-10-0-142-138.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx to ip-10-0-138-123.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-77f48536-52m6m Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-77f48536-52m6m to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-d122b0a3-w555c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d122b0a3-w555c to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl to ip-10-0-140-192.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-cbccff90-bzbdk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cbccff90-bzbdk to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-1a771e-qcw6l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1a771e-qcw6l to ip-10-0-138-123.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-a37c29-7rr5w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a37c29-7rr5w to ip-10-0-138-123.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd to ip-10-0-140-192.ec2.internal 40m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-c68724-tjk8p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c68724-tjk8p to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm to ip-10-0-140-192.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-0e518eb7-svcdl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0e518eb7-svcdl to ip-10-0-138-123.ec2.internal 40m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-250992-qcpvx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-250992-qcpvx to ip-10-0-138-123.ec2.internal 37m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-6d4cd0-mbkvb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6d4cd0-mbkvb to ip-10-0-138-123.ec2.internal 39m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-e1d6ff-nv5dm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1d6ff-nv5dm to ip-10-0-138-123.ec2.internal 8m8s Normal Scheduled pod/maas-api-revoke-keys-e2e-authcfg-http-95ffa8-wnfxx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-95ffa8-wnfxx to ip-10-0-138-123.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-d0bf268e-9sx99 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d0bf268e-9sx99 to ip-10-0-138-123.ec2.internal 10m Normal Scheduled pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-77f48536-f6d5599f-r27sq to ip-10-0-142-138.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-d0456d25-4pzbs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d0456d25-4pzbs to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 to ip-10-0-140-192.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-keys-e2e-derive-1d321437-6jknv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1d321437-6jknv to ip-10-0-138-123.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-fa29dbfd-tljdj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fa29dbfd-tljdj to ip-10-0-138-123.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-0b0bd3-7wqq5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0b0bd3-7wqq5 to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-cf74bcd1-tpbjj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cf74bcd1-tpbjj to ip-10-0-138-123.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-3d520d-zz2sk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3d520d-zz2sk to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-cf62fb1d-shbq4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cf62fb1d-shbq4 to ip-10-0-140-192.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-50caaa-vqvv4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-50caaa-vqvv4 to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw to ip-10-0-140-192.ec2.internal 35m Normal Scheduled pod/maas-api-revoke-sub-cec887dc-zhf55 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cec887dc-zhf55 to ip-10-0-138-123.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-ce124ea8-lh729 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ce124ea8-lh729 to ip-10-0-140-192.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-579ea7-mqxvb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-579ea7-mqxvb to ip-10-0-138-123.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-cc201b0a-mqqnf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cc201b0a-mqqnf to ip-10-0-138-123.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-5a2c68-kjp6h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5a2c68-kjp6h to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr to ip-10-0-140-192.ec2.internal 60m Normal Scheduled pod/maas-api-58c87df8db-cqkxd Successfully assigned odh-ai-gateway-infra/maas-api-58c87df8db-cqkxd to ip-10-0-142-138.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-b27079-h6gbj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b27079-h6gbj to ip-10-0-138-123.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-cb558bc6-qccnj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cb558bc6-qccnj to ip-10-0-138-123.ec2.internal 41m Normal Scheduled pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 to ip-10-0-142-138.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-850788c9-jsr92 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-850788c9-jsr92 to ip-10-0-138-123.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-57da7fbd-59f8r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-57da7fbd-59f8r to ip-10-0-140-192.ec2.internal 57m Normal Scheduled pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk to ip-10-0-142-138.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj to ip-10-0-142-138.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx to ip-10-0-142-138.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k to ip-10-0-138-123.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-027d32-xs2kl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-027d32-xs2kl to ip-10-0-138-123.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg to ip-10-0-140-192.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-4d5f483a-ncjwj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4d5f483a-ncjwj to ip-10-0-138-123.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-139f6e18-d8sqp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-139f6e18-d8sqp to ip-10-0-138-123.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-api-a-a37c29-56444d666-956qp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-a37c29-56444d666-956qp to ip-10-0-140-192.ec2.internal 45m Normal Scheduled pod/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn to ip-10-0-140-192.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-146d51ea-fswwr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-146d51ea-fswwr to ip-10-0-138-123.ec2.internal 55m Normal Scheduled pod/maas-api-revoke-sub-c9a01677-95tlq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c9a01677-95tlq to ip-10-0-138-123.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-212d76-mpmns Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-212d76-mpmns to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-4d38e5b7-rkwvk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4d38e5b7-rkwvk to ip-10-0-138-123.ec2.internal 46m Normal Scheduled pod/maas-api-revoke-sub-c788007c-9q2vk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c788007c-9q2vk to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-58ac21-tdl6v Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-58ac21-tdl6v to ip-10-0-138-123.ec2.internal 42m Normal Scheduled pod/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s to ip-10-0-140-192.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 to ip-10-0-138-123.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-954b03-226n4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-954b03-226n4 to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-c49662d4-9d4sm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c49662d4-9d4sm to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-ab76d3-8pcwp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ab76d3-8pcwp to ip-10-0-138-123.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-4cd8985e-vmzlw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4cd8985e-vmzlw to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k to ip-10-0-138-123.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-c4596400-k6xxc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c4596400-k6xxc to ip-10-0-138-123.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-c1e271a9-87mv4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-87mv4 to ip-10-0-140-192.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-dcb543-xt49w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dcb543-xt49w to ip-10-0-138-123.ec2.internal 42m Normal Scheduled pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 to ip-10-0-140-192.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-bcf68885-vbh4s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bcf68885-vbh4s to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln to ip-10-0-138-123.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-4b5df762-rvf2p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4b5df762-rvf2p to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-ba69d71a-t848b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ba69d71a-t848b to ip-10-0-140-192.ec2.internal 47m Normal Scheduled pod/maas-api-revoke-keys-e2e-migrate-1bd84be0-98vgl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1bd84be0-98vgl to ip-10-0-138-123.ec2.internal 41m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-47a126f3-hhtvw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47a126f3-hhtvw to ip-10-0-138-123.ec2.internal 44m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-987d6f93-dhp2x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-987d6f93-dhp2x to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb to ip-10-0-140-192.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w0-c839e5-s4mm4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w0-c839e5-s4mm4 to ip-10-0-138-123.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr to ip-10-0-140-192.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-48264bf5-gb8rm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-48264bf5-gb8rm to ip-10-0-140-192.ec2.internal 45m Normal Scheduled pod/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 to ip-10-0-142-138.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 to ip-10-0-140-192.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-178fe6f5-znclz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-178fe6f5-znclz to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w4-bb48ef-4rpzp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bb48ef-4rpzp to ip-10-0-140-192.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 to ip-10-0-142-138.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-5a29efb3-2qmt7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5a29efb3-2qmt7 to ip-10-0-140-192.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-452b6d7b-655cv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-655cv to ip-10-0-140-192.ec2.internal 41m Normal Scheduled pod/maas-api-revoke-sub-b9dc4ca1-97zql Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b9dc4ca1-97zql to ip-10-0-138-123.ec2.internal 41m Normal Scheduled pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw to ip-10-0-142-138.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6-8ss7g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6-8ss7g to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w3-25ff27-9ccj7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-25ff27-9ccj7 to ip-10-0-140-192.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x to ip-10-0-138-123.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w6-83a98b-kw2qf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w6-83a98b-kw2qf to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-b808bb44-dccnn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b808bb44-dccnn to ip-10-0-138-123.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-3e49c8d4-nln6d Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e49c8d4-nln6d to ip-10-0-138-123.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-sub-5bb87d8c-2crk5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5bb87d8c-2crk5 to ip-10-0-138-123.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w0-e69af1-qjszk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w0-e69af1-qjszk to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-b5cc126b-tfdh7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b5cc126b-tfdh7 to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 to ip-10-0-138-123.ec2.internal 9m43s Normal Scheduled pod/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd to ip-10-0-142-138.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-f7cfaca2-lg2lm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f7cfaca2-lg2lm to ip-10-0-140-192.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-f5c5a703-l7m2k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f5c5a703-l7m2k to ip-10-0-138-123.ec2.internal 57m Normal Scheduled pod/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs to ip-10-0-142-138.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-1b5f8846-x9mtn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1b5f8846-x9mtn to ip-10-0-140-192.ec2.internal 44m Normal Scheduled pod/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k to ip-10-0-142-138.ec2.internal 36m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w3-159cb7-5mzl4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-159cb7-5mzl4 to ip-10-0-138-123.ec2.internal 55m Normal Scheduled pod/maas-api-revoke-sub-d2052770-mwwwx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2052770-mwwwx to ip-10-0-138-123.ec2.internal 35m Normal Scheduled pod/maas-api-revoke-sub-d889b36d-nkmnt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d889b36d-nkmnt to ip-10-0-138-123.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-f4d3c14a-qblqw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f4d3c14a-qblqw to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-e2e-derive-1d321437-bc985d55-rnxwt Successfully assigned odh-ai-gateway-infra/maas-api-e2e-derive-1d321437-bc985d55-rnxwt to ip-10-0-140-192.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 to ip-10-0-140-192.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb to ip-10-0-140-192.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-21f66aed-cpkxc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-21f66aed-cpkxc to ip-10-0-140-192.ec2.internal 57m Normal Scheduled pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx to ip-10-0-142-138.ec2.internal 8m19s Normal Scheduled pod/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt to ip-10-0-138-123.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa-j2kg2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa-j2kg2 to ip-10-0-138-123.ec2.internal 36m Normal Scheduled pod/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld to ip-10-0-142-138.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-68ce5bd5-8n84j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-68ce5bd5-8n84j to ip-10-0-138-123.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-b5348059-7qh87 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b5348059-7qh87 to ip-10-0-138-123.ec2.internal 36m Normal Scheduled pod/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c to ip-10-0-142-138.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-b2985003-nqllm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b2985003-nqllm to ip-10-0-138-123.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-b154f532-8zf5q Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b154f532-8zf5q to ip-10-0-140-192.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-3e31a506-fqlnm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-fqlnm to ip-10-0-140-192.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-ae594979-xhh9k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-xhh9k to ip-10-0-140-192.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-5e55bce6-qjtlf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5e55bce6-qjtlf to ip-10-0-138-123.ec2.internal 7m17s Normal Scheduled pod/maas-api-revoke-sub-f03629db-skz5w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-skz5w to ip-10-0-138-123.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-225a1c9d-tzprk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-225a1c9d-tzprk to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-6e505391-p55cz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6e505391-p55cz to ip-10-0-138-123.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-sub-ef1e077a-m2l6d Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ef1e077a-m2l6d to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd to ip-10-0-142-138.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-de15e588-l95vt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-de15e588-l95vt to ip-10-0-138-123.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-6db36beb-tdq4m Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6db36beb-tdq4m to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-29891130-bhfsp Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29891130-bhfsp to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-29891145-jkvz4 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29891145-jkvz4 to ip-10-0-140-192.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-sub-62a7e053-klc87 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-62a7e053-klc87 to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-ef005ddb-k52p4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ef005ddb-k52p4 to ip-10-0-138-123.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-ec843018-57cd5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-57cd5 to ip-10-0-138-123.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-649a89e7-r76qs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-649a89e7-r76qs to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-66296450-6w46j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-66296450-6w46j to ip-10-0-138-123.ec2.internal 37m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w3-ba4687-dcsjf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-ba4687-dcsjf to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n to ip-10-0-142-138.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w6-1d454b-9n6p2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w6-1d454b-9n6p2 to ip-10-0-138-123.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-tvxdk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-tvxdk to ip-10-0-140-192.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-88d1c3-z8drg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-88d1c3-z8drg to ip-10-0-140-192.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-revoke-sub-ae45e2d5-qd85c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae45e2d5-qd85c to ip-10-0-138-123.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-aaf70013-ddf82 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-aaf70013-ddf82 to ip-10-0-138-123.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-a83f8028-qc4km Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a83f8028-qc4km to ip-10-0-138-123.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-jjng4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-jjng4 to ip-10-0-140-192.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-a83256ce-hm2k5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a83256ce-hm2k5 to ip-10-0-138-123.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 to ip-10-0-140-192.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-2411b96a-grmpw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2411b96a-grmpw to ip-10-0-138-123.ec2.internal 53m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t to ip-10-0-138-123.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-85237e45-gxvs6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-gxvs6 to ip-10-0-140-192.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-hndgq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-hndgq to ip-10-0-140-192.ec2.internal 36m Normal Scheduled pod/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s to ip-10-0-142-138.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-a4aef7d7-kqc6w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-kqc6w to ip-10-0-140-192.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-8e093027-l5zzg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8e093027-l5zzg to ip-10-0-138-123.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w2-1fb1c6-5x7b4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-1fb1c6-5x7b4 to ip-10-0-140-192.ec2.internal 42m Normal Scheduled pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 to ip-10-0-140-192.ec2.internal 23m Normal Scheduled pod/maas-api-key-cleanup-29891160-g9lth Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29891160-g9lth to ip-10-0-140-192.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-5p4hg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-5p4hg to ip-10-0-140-192.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-sub-3d20a2db-q8w8l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d20a2db-q8w8l to ip-10-0-138-123.ec2.internal 41m Normal Scheduled pod/maas-api-revoke-sub-39af5652-4tcfz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-39af5652-4tcfz to ip-10-0-138-123.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-6989c378-6rnkq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6989c378-6rnkq to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-d7cd689e-kwt2l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d7cd689e-kwt2l to ip-10-0-140-192.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-c51413-vhpk7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-c51413-vhpk7 to ip-10-0-140-192.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-ea11b86b-v6l4t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ea11b86b-v6l4t to ip-10-0-138-123.ec2.internal 33m Normal Scheduled pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck to ip-10-0-140-192.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-sub-d576e68b-zwxxc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-zwxxc to ip-10-0-140-192.ec2.internal 41m Normal Scheduled pod/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg to ip-10-0-142-138.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm to ip-10-0-140-192.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-d4c5e1eb-qbrx6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d4c5e1eb-qbrx6 to ip-10-0-138-123.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-34987b0e-4w2pq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-34987b0e-4w2pq to ip-10-0-140-192.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-d3fba056-7xfkb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-7xfkb to ip-10-0-140-192.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-6abd2c5a-skl72 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6abd2c5a-skl72 to ip-10-0-138-123.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-a429665a-7vm4r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a429665a-7vm4r to ip-10-0-138-123.ec2.internal 6m49s Normal Scheduled pod/maas-api-revoke-sub-6b19338f-gsmgn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-gsmgn to ip-10-0-138-123.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-6c6c9c62-2cq6r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6c6c9c62-2cq6r to ip-10-0-138-123.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-ec453a84-8ssfx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec453a84-8ssfx to ip-10-0-138-123.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf to ip-10-0-140-192.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w0-e1a7f5-fkjsn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e1a7f5-fkjsn to ip-10-0-138-123.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w1-7c933c-759x4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-7c933c-759x4 to ip-10-0-138-123.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-sub-2e1f5b5f-jcdj6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-jcdj6 to ip-10-0-140-192.ec2.internal 35m Normal Scheduled pod/maas-api-revoke-sub-a3b76fdb-fnj72 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a3b76fdb-fnj72 to ip-10-0-138-123.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-9e4adbf5-dp45p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9e4adbf5-dp45p to ip-10-0-138-123.ec2.internal 38m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h to ip-10-0-138-123.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-eb82de51-ssmzf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-eb82de51-ssmzf to ip-10-0-138-123.ec2.internal 8m19s Normal Scheduled pod/maas-api-key-cleanup-29891175-4ss7k Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29891175-4ss7k to ip-10-0-140-192.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-d2bff9eb-r4n2w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2bff9eb-r4n2w to ip-10-0-138-123.ec2.internal 41m Normal Scheduled pod/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 to ip-10-0-140-192.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-sub-d2bc93bc-wr2x2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-wr2x2 to ip-10-0-140-192.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-2c3af567-vkc9b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2c3af567-vkc9b to ip-10-0-138-123.ec2.internal 61m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-5cvwx 61m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 61m Normal AddedInterface pod/postgres-7cdbf6dc44-5cvwx Add eth0 [10.134.0.28/23] from ovn-kubernetes 61m Normal Pulling pod/postgres-7cdbf6dc44-5cvwx Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 61m Normal Created pod/postgres-7cdbf6dc44-5cvwx Container created 61m Normal Pulled pod/postgres-7cdbf6dc44-5cvwx Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 5.31s (5.31s including waiting). Image size: 403732742 bytes. 61m Normal Started pod/postgres-7cdbf6dc44-5cvwx Container started 60m Normal SuccessfulCreate replicaset/maas-api-6d669c7fcd Created pod: maas-api-6d669c7fcd-rsv7h 60m Warning FailedCreate replicaset/maas-api-6d669c7fcd Error creating: pods "maas-api-6d669c7fcd-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 60m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-6d669c7fcd from 0 to 1 60m Normal Pulling pod/maas-api-6d669c7fcd-rsv7h Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 60m Normal AddedInterface pod/maas-api-6d669c7fcd-rsv7h Add eth0 [10.134.0.32/23] from ovn-kubernetes 60m Normal Created pod/maas-api-6d669c7fcd-rsv7h Container created 60m Normal Pulled pod/maas-api-6d669c7fcd-rsv7h Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 1.522s (1.522s including waiting). Image size: 194581366 bytes. 60m Normal Started pod/maas-api-6d669c7fcd-rsv7h Container started 60m Normal SuccessfulCreate replicaset/maas-api-58c87df8db Created pod: maas-api-58c87df8db-cqkxd 60m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-58c87df8db from 0 to 1 60m Normal AddedInterface pod/maas-api-58c87df8db-cqkxd Add eth0 [10.132.0.54/23] from ovn-kubernetes 60m Normal Pulling pod/maas-api-58c87df8db-cqkxd Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 60m Normal Created pod/maas-api-58c87df8db-cqkxd Container created 60m Normal Pulled pod/maas-api-58c87df8db-cqkxd Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 3.265s (3.265s including waiting). Image size: 194581366 bytes. 60m Normal Started pod/maas-api-58c87df8db-cqkxd Container started 60m Normal SuccessfulDelete replicaset/maas-api-6d669c7fcd Deleted pod: maas-api-6d669c7fcd-rsv7h 60m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-6d669c7fcd from 1 to 0 60m Normal Killing pod/maas-api-6d669c7fcd-rsv7h Stopping container maas-api 57m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-7c933c Scaled up replica set maas-api-e2e-worker-w1-7c933c-74c99b8fd4 from 0 to 1 57m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-7c933c-74c99b8fd4 Created pod: maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk 57m Warning FailedMount pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w1-7c933c-serving-cert" not found 57m Normal Started pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Container started 57m Normal Created pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Container created 57m Normal Pulled pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 374ms (374ms including waiting). Image size: 194581366 bytes. 57m Normal Pulling pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 57m Normal AddedInterface pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Add eth0 [10.132.0.64/23] from ovn-kubernetes 57m Normal AddedInterface pod/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 Add eth0 [10.132.0.67/23] from ovn-kubernetes 57m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-e1a7f5-65698846fd Created pod: maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 57m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-e1a7f5 Scaled up replica set maas-api-e2e-worker-w0-e1a7f5-65698846fd from 0 to 1 57m Normal Pulling pod/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 57m Normal Started pod/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 Container started 57m Normal Pulled pod/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 341ms (341ms including waiting). Image size: 194581366 bytes. 57m Normal Created pod/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 Container created 57m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-5d73b9 Scaled up replica set maas-api-e2e-worker-w6-5d73b9-77c7968bf from 0 to 1 57m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-5d73b9-77c7968bf Created pod: maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx 57m Normal Pulled pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 387ms (387ms including waiting). Image size: 194581366 bytes. 57m Normal AddedInterface pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Add eth0 [10.132.0.74/23] from ovn-kubernetes 57m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-bb48ef-8f874f8b Created pod: maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs 57m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-bb48ef Scaled up replica set maas-api-e2e-worker-w4-bb48ef-8f874f8b from 0 to 1 57m Normal Pulling pod/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 57m Normal Pulled pod/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 270ms (270ms including waiting). Image size: 194581366 bytes. 57m Normal AddedInterface pod/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs Add eth0 [10.132.0.75/23] from ovn-kubernetes 57m Normal Created pod/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs Container created 57m Normal Started pod/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs Container started 57m Warning Unhealthy pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Readiness probe failed: Get "https://10.132.0.74:8443/health": dial tcp 10.132.0.74:8443: connect: connection refused 56m Normal Pulling pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-1fb1c6 Scaled up replica set maas-api-e2e-worker-w2-1fb1c6-6659f49fbd from 0 to 1 56m Normal Created pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Container created 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd Created pod: maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx 56m Normal Started pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Container started 56m Normal Pulling pod/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 56m Normal Pulled pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 302ms (302ms including waiting). Image size: 194581366 bytes. 56m Normal AddedInterface pod/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx Add eth0 [10.132.0.76/23] from ovn-kubernetes 56m Normal Pulled pod/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 344ms (344ms including waiting). Image size: 194581366 bytes. 56m Normal Started pod/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx Container started 56m Normal Created pod/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx Container created 56m Warning FailedMount pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w3-159cb7-serving-cert" not found 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-159cb7 Scaled up replica set maas-api-e2e-worker-w3-159cb7-9bc86b759 from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-159cb7-9bc86b759 Created pod: maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 56m Normal Pulling pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 56m Normal AddedInterface pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Add eth0 [10.134.0.51/23] from ovn-kubernetes 56m Normal Pulled pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 314ms (314ms including waiting). Image size: 194581366 bytes. 56m Normal Created pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Container created 56m Normal Started pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Container started 56m Normal AddedInterface pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Add eth0 [10.134.0.52/23] from ovn-kubernetes 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-e2e897 Scaled up replica set maas-api-e2e-worker-w5-e2e897-698bd9ddb6 from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-e2e897-698bd9ddb6 Created pod: maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 56m Normal Started pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Container started 56m Normal Created pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Container created 56m Normal Pulled pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 471ms (471ms including waiting). Image size: 194581366 bytes. 56m Normal Pulling pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 55m Normal SuccessfulCreate job/maas-api-revoke-sub-d2052770 Created pod: maas-api-revoke-sub-d2052770-mwwwx 55m Normal SuccessfulCreate job/maas-api-revoke-sub-c9a01677 Created pod: maas-api-revoke-sub-c9a01677-95tlq 55m Normal Pulling pod/maas-api-revoke-sub-d2052770-mwwwx Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 55m Normal AddedInterface pod/maas-api-revoke-sub-d2052770-mwwwx Add eth0 [10.133.0.41/23] from ovn-kubernetes 55m Normal AddedInterface pod/maas-api-revoke-sub-c9a01677-95tlq Add eth0 [10.133.0.42/23] from ovn-kubernetes 55m Normal Pulling pod/maas-api-revoke-sub-c9a01677-95tlq Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 55m Normal Created pod/maas-api-revoke-sub-d2052770-mwwwx Container created 55m Normal Started pod/maas-api-revoke-sub-d2052770-mwwwx Container started 55m Normal Pulled pod/maas-api-revoke-sub-d2052770-mwwwx Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.529s (2.529s including waiting). Image size: 107195206 bytes. 55m Normal Started pod/maas-api-revoke-sub-c9a01677-95tlq Container started 55m Normal Created pod/maas-api-revoke-sub-c9a01677-95tlq Container created 55m Normal Pulled pod/maas-api-revoke-sub-c9a01677-95tlq Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.142s (2.142s including waiting). Image size: 107195206 bytes. 55m Normal Completed job/maas-api-revoke-sub-c9a01677 Job completed 55m Normal Completed job/maas-api-revoke-sub-d2052770 Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-837afa08 Created pod: maas-api-revoke-sub-837afa08-9td2z 54m Normal Pulled pod/maas-api-revoke-sub-837afa08-9td2z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Started pod/maas-api-revoke-sub-837afa08-9td2z Container started 54m Normal AddedInterface pod/maas-api-revoke-sub-837afa08-9td2z Add eth0 [10.133.0.43/23] from ovn-kubernetes 54m Normal Created pod/maas-api-revoke-sub-837afa08-9td2z Container created 54m Normal Completed job/maas-api-revoke-sub-837afa08 Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-146d51ea Created pod: maas-api-revoke-sub-146d51ea-fswwr 54m Normal Started pod/maas-api-revoke-sub-146d51ea-fswwr Container started 54m Normal AddedInterface pod/maas-api-revoke-sub-146d51ea-fswwr Add eth0 [10.133.0.46/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-146d51ea-fswwr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-146d51ea-fswwr Container created 54m Normal Completed job/maas-api-revoke-sub-146d51ea Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-68ce5bd5 Created pod: maas-api-revoke-sub-68ce5bd5-8n84j 54m Normal Pulled pod/maas-api-revoke-sub-68ce5bd5-8n84j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-68ce5bd5-8n84j Container created 54m Normal AddedInterface pod/maas-api-revoke-sub-68ce5bd5-8n84j Add eth0 [10.133.0.48/23] from ovn-kubernetes 54m Normal Started pod/maas-api-revoke-sub-68ce5bd5-8n84j Container started 54m Normal SuccessfulCreate job/maas-api-revoke-sub-b5348059 Created pod: maas-api-revoke-sub-b5348059-7qh87 54m Normal Completed job/maas-api-revoke-sub-68ce5bd5 Job completed 54m Normal Started pod/maas-api-revoke-sub-b5348059-7qh87 Container started 54m Normal Pulled pod/maas-api-revoke-sub-b5348059-7qh87 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-b5348059-7qh87 Add eth0 [10.133.0.49/23] from ovn-kubernetes 54m Normal Created pod/maas-api-revoke-sub-b5348059-7qh87 Container created 54m Normal Completed job/maas-api-revoke-sub-b5348059 Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-a429665a Created pod: maas-api-revoke-sub-a429665a-7vm4r 54m Normal Started pod/maas-api-revoke-sub-a429665a-7vm4r Container started 54m Normal Created pod/maas-api-revoke-sub-a429665a-7vm4r Container created 54m Normal Pulled pod/maas-api-revoke-sub-a429665a-7vm4r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-a429665a-7vm4r Add eth0 [10.133.0.50/23] from ovn-kubernetes 54m Normal AddedInterface pod/maas-api-revoke-sub-ea11b86b-v6l4t Add eth0 [10.133.0.51/23] from ovn-kubernetes 54m Normal SuccessfulCreate job/maas-api-revoke-sub-ea11b86b Created pod: maas-api-revoke-sub-ea11b86b-v6l4t 54m Normal Pulled pod/maas-api-revoke-sub-ea11b86b-v6l4t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Started pod/maas-api-revoke-sub-ea11b86b-v6l4t Container started 54m Normal Created pod/maas-api-revoke-sub-ea11b86b-v6l4t Container created 54m Normal Pulling pod/maas-api-revoke-sub-57da7fbd-59f8r Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 54m Normal SuccessfulCreate job/maas-api-revoke-sub-57da7fbd Created pod: maas-api-revoke-sub-57da7fbd-59f8r 54m Normal SuccessfulCreate job/maas-api-revoke-sub-5e55bce6 Created pod: maas-api-revoke-sub-5e55bce6-qjtlf 54m Normal Pulled pod/maas-api-revoke-sub-5e55bce6-qjtlf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-57da7fbd-59f8r Add eth0 [10.134.0.58/23] from ovn-kubernetes 54m Normal AddedInterface pod/maas-api-revoke-sub-5e55bce6-qjtlf Add eth0 [10.133.0.52/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-79ce2fd4-fb9m9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-79ce2fd4-fb9m9 Add eth0 [10.133.0.53/23] from ovn-kubernetes 54m Normal Completed job/maas-api-revoke-sub-a429665a Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-79ce2fd4 Created pod: maas-api-revoke-sub-79ce2fd4-fb9m9 54m Normal Started pod/maas-api-revoke-sub-5e55bce6-qjtlf Container started 54m Normal Created pod/maas-api-revoke-sub-79ce2fd4-fb9m9 Container created 54m Normal Created pod/maas-api-revoke-sub-5e55bce6-qjtlf Container created 54m Normal Started pod/maas-api-revoke-sub-79ce2fd4-fb9m9 Container started 54m Normal Pulled pod/maas-api-revoke-sub-57da7fbd-59f8r Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.15s (2.15s including waiting). Image size: 107195206 bytes. 54m Normal Completed job/maas-api-revoke-sub-ea11b86b Job completed 54m Normal Created pod/maas-api-revoke-sub-57da7fbd-59f8r Container created 54m Normal Started pod/maas-api-revoke-sub-57da7fbd-59f8r Container started 54m Normal Completed job/maas-api-revoke-sub-79ce2fd4 Job completed 54m Normal Completed job/maas-api-revoke-sub-5e55bce6 Job completed 54m Normal Completed job/maas-api-revoke-sub-57da7fbd Job completed 54m Normal Started pod/maas-api-revoke-sub-e812571d-9tq2v Container started 54m Normal AddedInterface pod/maas-api-revoke-sub-e812571d-9tq2v Add eth0 [10.133.0.54/23] from ovn-kubernetes 54m Normal Created pod/maas-api-revoke-sub-e812571d-9tq2v Container created 54m Normal Pulled pod/maas-api-revoke-sub-e812571d-9tq2v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal SuccessfulCreate job/maas-api-revoke-sub-e812571d Created pod: maas-api-revoke-sub-e812571d-9tq2v 53m Normal SuccessfulCreate job/maas-api-revoke-sub-dc109b46 Created pod: maas-api-revoke-sub-dc109b46-p4zq2 53m Normal Completed job/maas-api-revoke-sub-e812571d Job completed 53m Normal Pulled pod/maas-api-revoke-sub-dc109b46-p4zq2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/maas-api-revoke-sub-dc109b46-p4zq2 Add eth0 [10.133.0.57/23] from ovn-kubernetes 53m Normal Started pod/maas-api-revoke-sub-dc109b46-p4zq2 Container started 53m Normal SuccessfulCreate job/maas-api-revoke-sub-fb23aebc Created pod: maas-api-revoke-sub-fb23aebc-644jd 53m Normal Created pod/maas-api-revoke-sub-dc109b46-p4zq2 Container created 53m Normal AddedInterface pod/maas-api-revoke-sub-fb23aebc-644jd Add eth0 [10.133.0.58/23] from ovn-kubernetes 53m Normal Pulled pod/maas-api-revoke-sub-fb23aebc-644jd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal SuccessfulCreate job/maas-api-revoke-sub-f7cfaca2 Created pod: maas-api-revoke-sub-f7cfaca2-lg2lm 53m Normal Pulled pod/maas-api-revoke-sub-f7cfaca2-lg2lm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Created pod/maas-api-revoke-sub-f7cfaca2-lg2lm Container created 53m Normal Started pod/maas-api-revoke-sub-fb23aebc-644jd Container started 53m Normal AddedInterface pod/maas-api-revoke-sub-f7cfaca2-lg2lm Add eth0 [10.134.0.60/23] from ovn-kubernetes 53m Normal Started pod/maas-api-revoke-sub-f7cfaca2-lg2lm Container started 53m Normal Created pod/maas-api-revoke-sub-fb23aebc-644jd Container created 53m Normal Completed job/maas-api-revoke-sub-dc109b46 Job completed 53m Normal SuccessfulCreate job/maas-api-revoke-sub-6e505391 Created pod: maas-api-revoke-sub-6e505391-p55cz 53m Normal Completed job/maas-api-revoke-sub-f7cfaca2 Job completed 53m Normal Completed job/maas-api-revoke-sub-fb23aebc Job completed 53m Normal SuccessfulCreate job/maas-api-revoke-sub-b5cc126b Created pod: maas-api-revoke-sub-b5cc126b-tfdh7 53m Normal Started pod/maas-api-revoke-sub-6e505391-p55cz Container started 53m Normal Created pod/maas-api-revoke-sub-6e505391-p55cz Container created 53m Normal Pulled pod/maas-api-revoke-sub-6e505391-p55cz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/maas-api-revoke-sub-6e505391-p55cz Add eth0 [10.133.0.59/23] from ovn-kubernetes 53m Normal Started pod/maas-api-revoke-sub-b5cc126b-tfdh7 Container started 53m Normal Created pod/maas-api-revoke-sub-b5cc126b-tfdh7 Container created 53m Normal Pulled pod/maas-api-revoke-sub-b5cc126b-tfdh7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/maas-api-revoke-sub-b5cc126b-tfdh7 Add eth0 [10.133.0.60/23] from ovn-kubernetes 53m Normal Completed job/maas-api-revoke-sub-6e505391 Job completed 53m Normal Completed job/maas-api-revoke-sub-b5cc126b Job completed 53m Normal SuccessfulCreate job/maas-api-revoke-sub-b808bb44 Created pod: maas-api-revoke-sub-b808bb44-dccnn 53m Normal Pulled pod/maas-api-revoke-sub-b808bb44-dccnn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Started pod/maas-api-revoke-sub-b808bb44-dccnn Container started 53m Normal AddedInterface pod/maas-api-revoke-sub-b808bb44-dccnn Add eth0 [10.133.0.61/23] from ovn-kubernetes 53m Normal Created pod/maas-api-revoke-sub-b808bb44-dccnn Container created 53m Normal Completed job/maas-api-revoke-sub-b808bb44 Job completed 53m Normal SuccessfulCreate job/maas-api-revoke-sub-8e093027 Created pod: maas-api-revoke-sub-8e093027-l5zzg 53m Normal Started pod/maas-api-revoke-sub-8e093027-l5zzg Container started 53m Normal Created pod/maas-api-revoke-sub-8e093027-l5zzg Container created 53m Normal AddedInterface pod/maas-api-revoke-sub-8e093027-l5zzg Add eth0 [10.133.0.62/23] from ovn-kubernetes 53m Normal Pulled pod/maas-api-revoke-sub-8e093027-l5zzg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Completed job/maas-api-revoke-sub-8e093027 Job completed 53m Normal Pulled pod/maas-api-revoke-sub-4d38e5b7-rkwvk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/maas-api-revoke-sub-4d38e5b7-rkwvk Add eth0 [10.133.0.63/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-revoke-sub-4d38e5b7 Created pod: maas-api-revoke-sub-4d38e5b7-rkwvk 53m Normal Started pod/maas-api-revoke-sub-4d38e5b7-rkwvk Container started 53m Normal Created pod/maas-api-revoke-sub-4d38e5b7-rkwvk Container created 53m Normal AddedInterface pod/maas-api-revoke-sub-2c3af567-vkc9b Add eth0 [10.133.0.64/23] from ovn-kubernetes 53m Normal Pulled pod/maas-api-revoke-sub-2c3af567-vkc9b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal SuccessfulCreate job/maas-api-revoke-sub-2c3af567 Created pod: maas-api-revoke-sub-2c3af567-vkc9b 53m Normal Started pod/maas-api-revoke-sub-2c3af567-vkc9b Container started 53m Normal Created pod/maas-api-revoke-sub-2c3af567-vkc9b Container created 53m Normal Completed job/maas-api-revoke-sub-4d38e5b7 Job completed 53m Normal Completed job/maas-api-revoke-sub-2c3af567 Job completed 53m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130 Created pod: maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 53m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130 Created pod: maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh 53m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl Add eth0 [10.134.0.65/23] from ovn-kubernetes 53m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh Add eth0 [10.133.0.67/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130 Created pod: maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-e1a7f5 Created job maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130 53m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130 Created pod: maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p 53m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p Add eth0 [10.134.0.66/23] from ovn-kubernetes 53m Normal AddedInterface pod/maas-api-key-cleanup-29891130-bhfsp Add eth0 [10.133.0.65/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130 Created pod: maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl 53m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg Add eth0 [10.134.0.67/23] from ovn-kubernetes 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-bb48ef Created job maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-1fb1c6 Created job maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-159cb7 Created job maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130 53m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t Add eth0 [10.133.0.69/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-key-cleanup-29891130 Created pod: maas-api-key-cleanup-29891130-bhfsp 53m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130 Created pod: maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx 53m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130 Created pod: maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-7c933c Created job maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-5d73b9 Created job maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29891130 53m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx Add eth0 [10.133.0.68/23] from ovn-kubernetes 53m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 Add eth0 [10.133.0.66/23] from ovn-kubernetes 53m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-e2e897 Created job maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130 53m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t Container created 53m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t Container started 53m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg Container started 53m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg Container created 53m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh_odh-ai-gateway-infra(3f3d2638-bcf8-42b5-92b2-3e11062b8803) 53m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t_odh-ai-gateway-infra(08cc9cb5-768b-46ed-9ce4-316adbaad04a) 53m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh Container created 53m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh Container started 53m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg_odh-ai-gateway-infra(7fce198a-0cb3-4ae2-9b19-c93c843155d7) 53m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130 Deleted pod: maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130-w7t4t 53m Normal Started pod/maas-api-key-cleanup-29891130-bhfsp Container started 53m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p Container created 53m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p Container started 53m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130-p7fmh 53m Normal Pulled pod/maas-api-key-cleanup-29891130-bhfsp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Created pod/maas-api-key-cleanup-29891130-bhfsp Container created 53m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130-wnjrg 53m Warning BackOff pod/maas-api-key-cleanup-29891130-bhfsp Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29891130-bhfsp_odh-ai-gateway-infra(4f582de5-ee06-41d8-bfe0-dc5f6a4389d1) 53m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl Container started 53m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 Container created 53m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-bb48ef Saw completed job: maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130, condition: Failed 53m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl Container created 53m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130 Job has reached the specified backoff limit 53m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx Container started 53m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 Container started 53m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx Container created 53m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130 Job has reached the specified backoff limit 53m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692_odh-ai-gateway-infra(c81f8f45-7d2a-4b19-8ad1-f8b0674b3eb6) 53m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w0-e1a7f5 Saw completed job: maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891130, condition: Failed 53m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p_odh-ai-gateway-infra(5bbe8e08-bd78-4316-9d34-220685d5ae63) 53m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891130 Job has reached the specified backoff limit 53m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-159cb7 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-159cb7-29891130, condition: Failed 53m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx 53m Normal SuccessfulDelete job/maas-api-key-cleanup-29891130 Deleted pod: maas-api-key-cleanup-29891130-bhfsp 53m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl_odh-ai-gateway-infra(8fdcf81e-d92a-4cf7-87f6-41df88673e40) 53m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130-7vdqx_odh-ai-gateway-infra(837e826a-4dbf-4e7e-a6de-3b117e7f72b4) 53m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130-9w57p 53m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130-sf692 53m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130-sxlcl 53m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29891130, condition: Failed 53m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-5d73b9 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130, condition: Failed 53m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130 Job has reached the specified backoff limit 53m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-e2e897 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-e2e897-29891130, condition: Failed 53m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29891130 Job has reached the specified backoff limit 53m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891130 Job has reached the specified backoff limit 52m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130 Job has reached the specified backoff limit 52m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-1fb1c6 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130, condition: Failed 52m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891130 Job has reached the specified backoff limit 52m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-7c933c Saw completed job: maas-api-key-cleanup-e2e-worker-w1-7c933c-29891130, condition: Failed 52m Normal AddedInterface pod/maas-api-revoke-sub-6c6c9c62-2cq6r Add eth0 [10.133.0.75/23] from ovn-kubernetes 52m Normal SuccessfulCreate job/maas-api-revoke-sub-6c6c9c62 Created pod: maas-api-revoke-sub-6c6c9c62-2cq6r 52m Normal Pulled pod/maas-api-revoke-sub-6c6c9c62-2cq6r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Created pod/maas-api-revoke-sub-6c6c9c62-2cq6r Container created 52m Normal Started pod/maas-api-revoke-sub-6c6c9c62-2cq6r Container started 52m Normal Completed job/maas-api-revoke-sub-6c6c9c62 Job completed 52m Normal SuccessfulCreate job/maas-api-revoke-sub-139f6e18 Created pod: maas-api-revoke-sub-139f6e18-d8sqp 52m Normal Created pod/maas-api-revoke-sub-139f6e18-d8sqp Container created 52m Normal AddedInterface pod/maas-api-revoke-sub-139f6e18-d8sqp Add eth0 [10.133.0.76/23] from ovn-kubernetes 52m Normal Pulled pod/maas-api-revoke-sub-139f6e18-d8sqp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Started pod/maas-api-revoke-sub-139f6e18-d8sqp Container started 52m Normal SuccessfulCreate job/maas-api-revoke-sub-f4d3c14a Created pod: maas-api-revoke-sub-f4d3c14a-qblqw 52m Normal Completed job/maas-api-revoke-sub-139f6e18 Job completed 52m Normal Started pod/maas-api-revoke-sub-f4d3c14a-qblqw Container started 52m Normal Created pod/maas-api-revoke-sub-f4d3c14a-qblqw Container created 52m Normal Pulled pod/maas-api-revoke-sub-f4d3c14a-qblqw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-api-revoke-sub-f4d3c14a-qblqw Add eth0 [10.133.0.77/23] from ovn-kubernetes 52m Normal SuccessfulCreate job/maas-api-revoke-sub-cb558bc6 Created pod: maas-api-revoke-sub-cb558bc6-qccnj 52m Normal Pulled pod/maas-api-revoke-sub-cb558bc6-qccnj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-api-revoke-sub-cb558bc6-qccnj Add eth0 [10.133.0.80/23] from ovn-kubernetes 52m Normal Started pod/maas-api-revoke-sub-cb558bc6-qccnj Container started 52m Normal Created pod/maas-api-revoke-sub-cb558bc6-qccnj Container created 52m Normal Completed job/maas-api-revoke-sub-f4d3c14a Job completed 52m Normal Completed job/maas-api-revoke-sub-cb558bc6 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-4cd8985e Created pod: maas-api-revoke-sub-4cd8985e-vmzlw 51m Normal Started pod/maas-api-revoke-sub-4cd8985e-vmzlw Container started 51m Normal Pulled pod/maas-api-revoke-sub-4cd8985e-vmzlw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Created pod/maas-api-revoke-sub-4cd8985e-vmzlw Container created 51m Normal AddedInterface pod/maas-api-revoke-sub-4cd8985e-vmzlw Add eth0 [10.133.0.83/23] from ovn-kubernetes 51m Normal Completed job/maas-api-revoke-sub-4cd8985e Job completed 51m Normal AddedInterface pod/maas-api-revoke-sub-850788c9-jsr92 Add eth0 [10.133.0.84/23] from ovn-kubernetes 51m Normal Pulled pod/maas-api-revoke-sub-850788c9-jsr92 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal SuccessfulCreate job/maas-api-revoke-sub-850788c9 Created pod: maas-api-revoke-sub-850788c9-jsr92 51m Normal Started pod/maas-api-revoke-sub-850788c9-jsr92 Container started 51m Normal Created pod/maas-api-revoke-sub-850788c9-jsr92 Container created 51m Normal Completed job/maas-api-revoke-sub-850788c9 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-4b5df762 Created pod: maas-api-revoke-sub-4b5df762-rvf2p 51m Normal Pulled pod/maas-api-revoke-sub-4b5df762-rvf2p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-4b5df762-rvf2p Add eth0 [10.133.0.88/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-4b5df762-rvf2p Container created 51m Normal Started pod/maas-api-revoke-sub-4b5df762-rvf2p Container started 51m Normal Completed job/maas-api-revoke-sub-4b5df762 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-c4596400 Created pod: maas-api-revoke-sub-c4596400-k6xxc 51m Normal Pulled pod/maas-api-revoke-sub-c4596400-k6xxc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Started pod/maas-api-revoke-sub-c4596400-k6xxc Container started 51m Normal Created pod/maas-api-revoke-sub-c4596400-k6xxc Container created 51m Normal AddedInterface pod/maas-api-revoke-sub-c4596400-k6xxc Add eth0 [10.133.0.90/23] from ovn-kubernetes 51m Normal Completed job/maas-api-revoke-sub-c4596400 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-bcf68885 Created pod: maas-api-revoke-sub-bcf68885-vbh4s 51m Normal AddedInterface pod/maas-api-revoke-sub-bcf68885-vbh4s Add eth0 [10.133.0.93/23] from ovn-kubernetes 51m Normal Pulled pod/maas-api-revoke-sub-bcf68885-vbh4s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Created pod/maas-api-revoke-sub-bcf68885-vbh4s Container created 51m Normal Started pod/maas-api-revoke-sub-bcf68885-vbh4s Container started 51m Normal SuccessfulCreate job/maas-api-revoke-sub-3e49c8d4 Created pod: maas-api-revoke-sub-3e49c8d4-nln6d 51m Normal Started pod/maas-api-revoke-sub-3e49c8d4-nln6d Container started 51m Normal Pulled pod/maas-api-revoke-sub-3e49c8d4-nln6d Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-3e49c8d4-nln6d Add eth0 [10.133.0.94/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-3e49c8d4-nln6d Container created 51m Normal Completed job/maas-api-revoke-sub-bcf68885 Job completed 51m Normal Pulled pod/maas-api-revoke-sub-cc201b0a-mqqnf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal SuccessfulCreate job/maas-api-revoke-sub-cc201b0a Created pod: maas-api-revoke-sub-cc201b0a-mqqnf 51m Normal SuccessfulCreate job/maas-api-revoke-sub-48264bf5 Created pod: maas-api-revoke-sub-48264bf5-gb8rm 51m Normal AddedInterface pod/maas-api-revoke-sub-cc201b0a-mqqnf Add eth0 [10.133.0.95/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-cc201b0a-mqqnf Container created 51m Normal Pulled pod/maas-api-revoke-sub-48264bf5-gb8rm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Created pod/maas-api-revoke-sub-48264bf5-gb8rm Container created 51m Normal Started pod/maas-api-revoke-sub-48264bf5-gb8rm Container started 51m Normal Started pod/maas-api-revoke-sub-cc201b0a-mqqnf Container started 51m Normal AddedInterface pod/maas-api-revoke-sub-48264bf5-gb8rm Add eth0 [10.134.0.84/23] from ovn-kubernetes 51m Normal Completed job/maas-api-revoke-sub-3e49c8d4 Job completed 50m Normal Pulled pod/maas-api-revoke-sub-0e518eb7-svcdl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Completed job/maas-api-revoke-sub-cc201b0a Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-0e518eb7 Created pod: maas-api-revoke-sub-0e518eb7-svcdl 50m Normal Completed job/maas-api-revoke-sub-48264bf5 Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-0e518eb7-svcdl Add eth0 [10.133.0.96/23] from ovn-kubernetes 50m Normal Created pod/maas-api-revoke-sub-0e518eb7-svcdl Container created 50m Normal Started pod/maas-api-revoke-sub-0e518eb7-svcdl Container started 50m Normal Completed job/maas-api-revoke-sub-0e518eb7 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-d2bff9eb Created pod: maas-api-revoke-sub-d2bff9eb-r4n2w 50m Normal AddedInterface pod/maas-api-revoke-sub-d2bff9eb-r4n2w Add eth0 [10.133.0.97/23] from ovn-kubernetes 50m Normal Started pod/maas-api-revoke-sub-d2bff9eb-r4n2w Container started 50m Normal Created pod/maas-api-revoke-sub-d2bff9eb-r4n2w Container created 50m Normal Pulled pod/maas-api-revoke-sub-d2bff9eb-r4n2w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Completed job/maas-api-revoke-sub-d2bff9eb Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-ddf29834 Created pod: maas-api-revoke-sub-ddf29834-fgm24 50m Normal Pulled pod/maas-api-revoke-sub-ddf29834-fgm24 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-ddf29834-fgm24 Container created 50m Normal Started pod/maas-api-revoke-sub-ddf29834-fgm24 Container started 50m Normal AddedInterface pod/maas-api-revoke-sub-ddf29834-fgm24 Add eth0 [10.133.0.99/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-de15e588 Created pod: maas-api-revoke-sub-de15e588-l95vt 50m Normal SuccessfulCreate job/maas-api-revoke-sub-fa29dbfd Created pod: maas-api-revoke-sub-fa29dbfd-tljdj 50m Normal AddedInterface pod/maas-api-revoke-sub-fa29dbfd-tljdj Add eth0 [10.133.0.101/23] from ovn-kubernetes 50m Normal Completed job/maas-api-revoke-sub-ddf29834 Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-de15e588-l95vt Add eth0 [10.133.0.100/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-de15e588-l95vt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Pulled pod/maas-api-revoke-sub-fa29dbfd-tljdj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-de15e588-l95vt Container created 50m Normal Created pod/maas-api-revoke-sub-fa29dbfd-tljdj Container created 50m Normal Started pod/maas-api-revoke-sub-de15e588-l95vt Container started 50m Normal Started pod/maas-api-revoke-sub-fa29dbfd-tljdj Container started 50m Normal SuccessfulCreate job/maas-api-revoke-sub-21f66aed Created pod: maas-api-revoke-sub-21f66aed-cpkxc 50m Normal AddedInterface pod/maas-api-revoke-sub-21f66aed-cpkxc Add eth0 [10.134.0.86/23] from ovn-kubernetes 50m Normal Created pod/maas-api-revoke-sub-21f66aed-cpkxc Container created 50m Normal Started pod/maas-api-revoke-sub-21f66aed-cpkxc Container started 50m Normal Pulled pod/maas-api-revoke-sub-21f66aed-cpkxc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Completed job/maas-api-revoke-sub-fa29dbfd Job completed 50m Normal Completed job/maas-api-revoke-sub-de15e588 Job completed 50m Normal Completed job/maas-api-revoke-sub-21f66aed Job completed 50m Normal Pulled pod/maas-api-revoke-sub-4d5f483a-ncjwj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal SuccessfulCreate job/maas-api-revoke-sub-4d5f483a Created pod: maas-api-revoke-sub-4d5f483a-ncjwj 50m Normal AddedInterface pod/maas-api-revoke-sub-4d5f483a-ncjwj Add eth0 [10.133.0.102/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-6989c378 Created pod: maas-api-revoke-sub-6989c378-6rnkq 50m Normal Started pod/maas-api-revoke-sub-4d5f483a-ncjwj Container started 50m Normal Created pod/maas-api-revoke-sub-4d5f483a-ncjwj Container created 50m Normal Started pod/maas-api-revoke-sub-6989c378-6rnkq Container started 50m Normal Created pod/maas-api-revoke-sub-6989c378-6rnkq Container created 50m Normal Pulled pod/maas-api-revoke-sub-6989c378-6rnkq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-6989c378-6rnkq Add eth0 [10.133.0.103/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-d0bf268e-9sx99 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Completed job/maas-api-revoke-sub-4d5f483a Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-d0bf268e-9sx99 Add eth0 [10.133.0.104/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-d0bf268e Created pod: maas-api-revoke-sub-d0bf268e-9sx99 50m Normal Completed job/maas-api-revoke-sub-6989c378 Job completed 50m Normal Started pod/maas-api-revoke-sub-d0bf268e-9sx99 Container started 50m Normal Created pod/maas-api-revoke-sub-d0bf268e-9sx99 Container created 50m Normal SuccessfulCreate job/maas-api-revoke-sub-e8f06945 Created pod: maas-api-revoke-sub-e8f06945-xm42k 50m Normal Completed job/maas-api-revoke-sub-d0bf268e Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-e8f06945-xm42k Add eth0 [10.133.0.105/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-e8f06945-xm42k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-e8f06945-xm42k Container created 50m Normal Started pod/maas-api-revoke-sub-e8f06945-xm42k Container started 50m Normal Completed job/maas-api-revoke-sub-e8f06945 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-7e25e985 Created pod: maas-api-revoke-sub-7e25e985-hf8xg 50m Normal SuccessfulCreate job/maas-api-revoke-sub-178fe6f5 Created pod: maas-api-revoke-sub-178fe6f5-znclz 50m Normal Pulled pod/maas-api-revoke-sub-178fe6f5-znclz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-7e25e985-hf8xg Add eth0 [10.133.0.107/23] from ovn-kubernetes 50m Normal Created pod/maas-api-revoke-sub-178fe6f5-znclz Container created 50m Normal Started pod/maas-api-revoke-sub-178fe6f5-znclz Container started 50m Normal Started pod/maas-api-revoke-sub-7e25e985-hf8xg Container started 50m Normal Created pod/maas-api-revoke-sub-7e25e985-hf8xg Container created 50m Normal Pulled pod/maas-api-revoke-sub-7e25e985-hf8xg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal SuccessfulCreate job/maas-api-revoke-sub-81828ed1 Created pod: maas-api-revoke-sub-81828ed1-xbjjx 50m Normal AddedInterface pod/maas-api-revoke-sub-178fe6f5-znclz Add eth0 [10.133.0.106/23] from ovn-kubernetes 50m Normal Started pod/maas-api-revoke-sub-81828ed1-xbjjx Container started 50m Normal Pulled pod/maas-api-revoke-sub-81828ed1-xbjjx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-81828ed1-xbjjx Add eth0 [10.134.0.87/23] from ovn-kubernetes 50m Normal Created pod/maas-api-revoke-sub-81828ed1-xbjjx Container created 50m Normal Completed job/maas-api-revoke-sub-7e25e985 Job completed 50m Normal Completed job/maas-api-revoke-sub-178fe6f5 Job completed 50m Normal Completed job/maas-api-revoke-sub-81828ed1 Job completed 49m Normal SuccessfulCreate job/maas-api-revoke-sub-ec453a84 Created pod: maas-api-revoke-sub-ec453a84-8ssfx 49m Normal Pulled pod/maas-api-revoke-sub-ec453a84-8ssfx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-sub-ec453a84-8ssfx Container created 49m Normal Started pod/maas-api-revoke-sub-ec453a84-8ssfx Container started 49m Normal AddedInterface pod/maas-api-revoke-sub-ec453a84-8ssfx Add eth0 [10.133.0.110/23] from ovn-kubernetes 49m Normal SuccessfulCreate job/maas-api-revoke-sub-c49662d4 Created pod: maas-api-revoke-sub-c49662d4-9d4sm 49m Normal Started pod/maas-api-revoke-sub-c49662d4-9d4sm Container started 49m Normal AddedInterface pod/maas-api-revoke-sub-c49662d4-9d4sm Add eth0 [10.133.0.111/23] from ovn-kubernetes 49m Normal Created pod/maas-api-revoke-sub-c49662d4-9d4sm Container created 49m Normal Pulled pod/maas-api-revoke-sub-c49662d4-9d4sm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal SuccessfulCreate job/maas-api-revoke-sub-d122b0a3 Created pod: maas-api-revoke-sub-d122b0a3-w555c 49m Normal Completed job/maas-api-revoke-sub-ec453a84 Job completed 49m Normal AddedInterface pod/maas-api-revoke-sub-d122b0a3-w555c Add eth0 [10.133.0.112/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-revoke-sub-d122b0a3-w555c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-sub-d122b0a3-w555c Container created 49m Normal Started pod/maas-api-revoke-sub-d122b0a3-w555c Container started 49m Normal Completed job/maas-api-revoke-sub-c49662d4 Job completed 49m Normal Completed job/maas-api-revoke-sub-d122b0a3 Job completed 49m Normal SuccessfulCreate job/maas-api-revoke-sub-2411b96a Created pod: maas-api-revoke-sub-2411b96a-grmpw 49m Normal Started pod/maas-api-revoke-sub-2411b96a-grmpw Container started 49m Normal Created pod/maas-api-revoke-sub-2411b96a-grmpw Container created 49m Normal AddedInterface pod/maas-api-revoke-sub-2411b96a-grmpw Add eth0 [10.133.0.116/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-revoke-sub-2411b96a-grmpw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal SuccessfulCreate job/maas-api-revoke-sub-cf74bcd1 Created pod: maas-api-revoke-sub-cf74bcd1-tpbjj 49m Normal Started pod/maas-api-revoke-sub-cf74bcd1-tpbjj Container started 49m Normal AddedInterface pod/maas-api-revoke-sub-cf74bcd1-tpbjj Add eth0 [10.133.0.117/23] from ovn-kubernetes 49m Normal SuccessfulCreate job/maas-api-revoke-sub-d7cd689e Created pod: maas-api-revoke-sub-d7cd689e-kwt2l 49m Normal Pulled pod/maas-api-revoke-sub-cf74bcd1-tpbjj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-sub-cf74bcd1-tpbjj Container created 49m Normal AddedInterface pod/maas-api-revoke-sub-d7cd689e-kwt2l Add eth0 [10.134.0.93/23] from ovn-kubernetes 49m Normal Created pod/maas-api-revoke-sub-d7cd689e-kwt2l Container created 49m Normal Started pod/maas-api-revoke-sub-d7cd689e-kwt2l Container started 49m Normal Pulled pod/maas-api-revoke-sub-d7cd689e-kwt2l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Completed job/maas-api-revoke-sub-2411b96a Job completed 49m Normal Completed job/maas-api-revoke-sub-cf74bcd1 Job completed 49m Normal Completed job/maas-api-revoke-sub-d7cd689e Job completed 49m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-cbccff90 Scaled up replica set maas-api-e2e-ait-cbccff90-5cbddc9c55 from 0 to 1 49m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-cbccff90-5cbddc9c55 Created pod: maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw 49m Normal Created pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Container created 49m Normal Pulling pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 49m Normal AddedInterface pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Add eth0 [10.134.0.95/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 358ms (358ms including waiting). Image size: 194581366 bytes. 49m Normal Started pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Container started 49m Normal SuccessfulCreate job/maas-api-revoke-sub-66296450 Created pod: maas-api-revoke-sub-66296450-6w46j 49m Normal AddedInterface pod/maas-api-revoke-sub-66296450-6w46j Add eth0 [10.133.0.122/23] from ovn-kubernetes 49m Normal Started pod/maas-api-revoke-sub-66296450-6w46j Container started 49m Normal Created pod/maas-api-revoke-sub-66296450-6w46j Container created 49m Normal Pulled pod/maas-api-revoke-sub-66296450-6w46j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Completed job/maas-api-revoke-sub-66296450 Job completed 49m Normal ScalingReplicaSet deployment/maas-api-e2e-derive-1d321437 Scaled up replica set maas-api-e2e-derive-1d321437-bc985d55 from 0 to 1 49m Normal AddedInterface pod/maas-api-e2e-derive-1d321437-bc985d55-rnxwt Add eth0 [10.134.0.96/23] from ovn-kubernetes 49m Normal SuccessfulCreate replicaset/maas-api-e2e-derive-1d321437-bc985d55 Created pod: maas-api-e2e-derive-1d321437-bc985d55-rnxwt 49m Normal Started pod/maas-api-e2e-derive-1d321437-bc985d55-rnxwt Container started 49m Normal Created pod/maas-api-e2e-derive-1d321437-bc985d55-rnxwt Container created 49m Normal Pulled pod/maas-api-e2e-derive-1d321437-bc985d55-rnxwt Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 349ms (349ms including waiting). Image size: 194581366 bytes. 49m Normal Pulling pod/maas-api-e2e-derive-1d321437-bc985d55-rnxwt Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 49m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-42dad67e Scaled up replica set maas-api-e2e-ait-42dad67e-8546ffcdf8 from 0 to 1 49m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-42dad67e-8546ffcdf8 Created pod: maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 49m Warning FailedMount pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-42dad67e-serving-cert" not found 49m Normal Created pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 Container created 49m Normal Started pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 Container started 49m Normal AddedInterface pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 Add eth0 [10.134.0.97/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 458ms (458ms including waiting). Image size: 194581366 bytes. 49m Normal Pulling pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 49m Normal SuccessfulCreate job/maas-api-revoke-sub-5bb87d8c Created pod: maas-api-revoke-sub-5bb87d8c-2crk5 48m Normal AddedInterface pod/maas-api-revoke-sub-5bb87d8c-2crk5 Add eth0 [10.133.0.123/23] from ovn-kubernetes 48m Normal Created pod/maas-api-revoke-sub-5bb87d8c-2crk5 Container created 48m Normal Pulled pod/maas-api-revoke-sub-5bb87d8c-2crk5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal Started pod/maas-api-revoke-sub-5bb87d8c-2crk5 Container started 48m Normal Completed job/maas-api-revoke-sub-5bb87d8c Job completed 48m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-cbccff90 Created pod: maas-api-revoke-keys-e2e-ait-cbccff90-bzbdk 48m Normal Started pod/maas-api-revoke-keys-e2e-ait-cbccff90-bzbdk Container started 48m Normal Created pod/maas-api-revoke-keys-e2e-ait-cbccff90-bzbdk Container created 48m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-cbccff90-bzbdk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-cbccff90-bzbdk Add eth0 [10.133.0.124/23] from ovn-kubernetes 48m Normal Completed job/maas-api-revoke-keys-e2e-ait-cbccff90 Job completed 48m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-derive-1d321437 Created pod: maas-api-revoke-keys-e2e-derive-1d321437-6jknv 48m Normal Pulled pod/maas-api-revoke-keys-e2e-derive-1d321437-6jknv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal Created pod/maas-api-revoke-keys-e2e-derive-1d321437-6jknv Container created 48m Normal AddedInterface pod/maas-api-revoke-keys-e2e-derive-1d321437-6jknv Add eth0 [10.133.0.125/23] from ovn-kubernetes 48m Normal Started pod/maas-api-revoke-keys-e2e-derive-1d321437-6jknv Container started 48m Normal Completed job/maas-api-revoke-keys-e2e-derive-1d321437 Job completed 48m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-42dad67e Created pod: maas-api-revoke-keys-e2e-ait-42dad67e-zcdx6 48m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-42dad67e-zcdx6 Add eth0 [10.133.0.126/23] from ovn-kubernetes 48m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-42dad67e-zcdx6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal Created pod/maas-api-revoke-keys-e2e-ait-42dad67e-zcdx6 Container created 48m Normal Started pod/maas-api-revoke-keys-e2e-ait-42dad67e-zcdx6 Container started 48m Normal Completed job/maas-api-revoke-keys-e2e-ait-42dad67e Job completed 48m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ait-cbccff90 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ait-cbccff90: Operation cannot be fulfilled on endpoints "maas-api-e2e-ait-cbccff90": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ait-cbccff90, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eea25866-3a70-4d88-b908-410ce6743ff6, UID in object meta: 48m Normal Killing pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Stopping container maas-api 48m Warning Unhealthy pod/maas-api-e2e-ait-cbccff90-5cbddc9c55-mhthw Readiness probe failed: Get "https://10.134.0.95:8443/health": context deadline exceeded 48m Normal Killing pod/maas-api-e2e-derive-1d321437-bc985d55-rnxwt Stopping container maas-api 48m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-derive-1d321437 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-derive-1d321437: Operation cannot be fulfilled on endpoints "maas-api-e2e-derive-1d321437": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-derive-1d321437, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 06f86dba-acb1-42c2-aa16-3c1db78a8956, UID in object meta: 48m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ait-42dad67e Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ait-42dad67e: Operation cannot be fulfilled on endpoints "maas-api-e2e-ait-42dad67e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ait-42dad67e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c34d88fc-615c-40c4-b546-57ab8d177e66, UID in object meta: 48m Normal Killing pod/maas-api-e2e-ait-42dad67e-8546ffcdf8-nkbh7 Stopping container maas-api 48m Normal ScalingReplicaSet deployment/maas-api-e2e-migrate-1bd84be0 Scaled up replica set maas-api-e2e-migrate-1bd84be0-74c676d494 from 0 to 1 48m Normal SuccessfulCreate replicaset/maas-api-e2e-migrate-1bd84be0-74c676d494 Created pod: maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb 48m Normal Pulled pod/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 426ms (426ms including waiting). Image size: 194581366 bytes. 48m Normal AddedInterface pod/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb Add eth0 [10.134.0.104/23] from ovn-kubernetes 48m Normal Pulling pod/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 48m Normal Started pod/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb Container started 48m Normal Created pod/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb Container created 47m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-5d6f1188 Scaled up replica set maas-api-e2e-ait-5d6f1188-747c7c9b78 from 0 to 1 47m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-5d6f1188-747c7c9b78 Created pod: maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd 47m Normal AddedInterface pod/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd Add eth0 [10.134.0.105/23] from ovn-kubernetes 47m Normal Pulling pod/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 47m Normal Pulled pod/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 307ms (307ms including waiting). Image size: 194581366 bytes. 47m Normal Started pod/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd Container started 47m Normal Created pod/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd Container created 47m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-migrate-1bd84be0 Created pod: maas-api-revoke-keys-e2e-migrate-1bd84be0-98vgl 47m Normal Started pod/maas-api-revoke-keys-e2e-migrate-1bd84be0-98vgl Container started 47m Normal AddedInterface pod/maas-api-revoke-keys-e2e-migrate-1bd84be0-98vgl Add eth0 [10.133.0.127/23] from ovn-kubernetes 47m Normal Pulled pod/maas-api-revoke-keys-e2e-migrate-1bd84be0-98vgl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 47m Normal Created pod/maas-api-revoke-keys-e2e-migrate-1bd84be0-98vgl Container created 47m Normal Completed job/maas-api-revoke-keys-e2e-migrate-1bd84be0 Job completed 47m Normal Killing pod/maas-api-e2e-migrate-1bd84be0-74c676d494-mf6gb Stopping container maas-api 47m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-5d6f1188 Created pod: maas-api-revoke-keys-e2e-ait-5d6f1188-2c7wb 47m Normal Started pod/maas-api-revoke-keys-e2e-ait-5d6f1188-2c7wb Container started 47m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-5d6f1188-2c7wb Add eth0 [10.133.0.128/23] from ovn-kubernetes 47m Normal Created pod/maas-api-revoke-keys-e2e-ait-5d6f1188-2c7wb Container created 47m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-5d6f1188-2c7wb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 47m Normal Completed job/maas-api-revoke-keys-e2e-ait-5d6f1188 Job completed 47m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w3-25ff27 Scaled up replica set maas-api-e2e-shared-a-w3-25ff27-5f5d69445c from 0 to 1 47m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c Created pod: maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg 47m Normal Created pod/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg Container created 47m Normal Pulled pod/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 404ms (404ms including waiting). Image size: 194581366 bytes. 47m Normal AddedInterface pod/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg Add eth0 [10.134.0.112/23] from ovn-kubernetes 47m Normal Pulling pod/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 46m Normal Started pod/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg Container started 46m Normal Killing pod/maas-api-e2e-ait-5d6f1188-747c7c9b78-mhxdd Stopping container maas-api 46m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-987d6f93-85d854d56d Created pod: maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 46m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-987d6f93 Scaled up replica set maas-api-e2e-mt-987d6f93-85d854d56d from 0 to 1 46m Normal AddedInterface pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Add eth0 [10.132.0.109/23] from ovn-kubernetes 46m Normal Pulled pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 368ms (368ms including waiting). Image size: 194581366 bytes. 46m Warning Unhealthy pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Readiness probe failed: Get "https://10.132.0.109:8443/health": dial tcp 10.132.0.109:8443: connect: connection refused 46m Normal SuccessfulCreate job/maas-api-revoke-sub-c788007c Created pod: maas-api-revoke-sub-c788007c-9q2vk 46m Normal Created pod/maas-api-revoke-sub-c788007c-9q2vk Container created 46m Normal Pulled pod/maas-api-revoke-sub-c788007c-9q2vk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 46m Normal AddedInterface pod/maas-api-revoke-sub-c788007c-9q2vk Add eth0 [10.133.0.130/23] from ovn-kubernetes 46m Normal Started pod/maas-api-revoke-sub-c788007c-9q2vk Container started 46m Normal Pulling pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 46m Normal Pulled pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 340ms (340ms including waiting). Image size: 194581366 bytes. 46m Normal Created pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Container created 46m Normal Started pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Container started 46m Normal Completed job/maas-api-revoke-sub-c788007c Job completed 46m Warning FailedMount pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-a-w6-83a98b-serving-cert" not found 46m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w6-83a98b Scaled up replica set maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f from 0 to 1 46m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f Created pod: maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj 46m Normal Started pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj Container started 46m Normal Created pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj Container created 46m Normal Pulled pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 431ms (431ms including waiting). Image size: 194581366 bytes. 46m Normal Pulling pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 46m Normal AddedInterface pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj Add eth0 [10.132.0.110/23] from ovn-kubernetes 46m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w3-ba4687-75c45c7564 Created pod: maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c 46m Warning FailedMount pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-b-w3-ba4687-serving-cert" not found 46m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w3-ba4687 Scaled up replica set maas-api-e2e-shared-b-w3-ba4687-75c45c7564 from 0 to 1 46m Normal Pulling pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 46m Normal AddedInterface pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Add eth0 [10.132.0.111/23] from ovn-kubernetes 46m Normal Pulled pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 334ms (334ms including waiting). Image size: 194581366 bytes. 46m Normal Created pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Container created 46m Normal Started pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Container started 45m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w1-e2dfd6 Scaled up replica set maas-api-e2e-shared-a-w1-e2dfd6-764589d498 from 0 to 1 45m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w1-e2dfd6-764589d498 Created pod: maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn 45m Normal AddedInterface pod/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn Add eth0 [10.134.0.120/23] from ovn-kubernetes 45m Normal Pulling pod/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 45m Normal Started pod/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn Container started 45m Normal Created pod/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn Container created 45m Normal Pulled pod/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 648ms (648ms including waiting). Image size: 194581366 bytes. 45m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865 Created pod: maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 45m Normal AddedInterface pod/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 Add eth0 [10.132.0.112/23] from ovn-kubernetes 45m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w0-c839e5 Scaled up replica set maas-api-e2e-shared-a-w0-c839e5-5bc57f9865 from 0 to 1 45m Normal Pulling pod/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 45m Normal Started pod/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 Container started 45m Normal Created pod/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 Container created 45m Normal Pulled pod/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 332ms (332ms including waiting). Image size: 194581366 bytes. 45m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f Created pod: maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 45m Normal AddedInterface pod/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 Add eth0 [10.132.0.113/23] from ovn-kubernetes 45m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w6-1d454b Scaled up replica set maas-api-e2e-shared-b-w6-1d454b-69cd44b65f from 0 to 1 45m Normal Pulling pod/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 45m Normal Pulled pod/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 363ms (363ms including waiting). Image size: 194581366 bytes. 45m Normal Created pod/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 Container created 45m Normal Started pod/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 Container started 44m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-47a126f3 Scaled up replica set maas-api-e2e-mt-47a126f3-dc8779d86 from 0 to 1 44m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-47a126f3-dc8779d86 Created pod: maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k 44m Normal Created pod/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k Container created 44m Normal AddedInterface pod/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k Add eth0 [10.132.0.114/23] from ovn-kubernetes 44m Normal Started pod/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k Container started 44m Normal Pulled pod/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 345ms (345ms including waiting). Image size: 194581366 bytes. 44m Normal Pulling pod/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 44m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-987d6f93-dhp2x Add eth0 [10.133.0.140/23] from ovn-kubernetes 44m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-987d6f93 Created pod: maas-api-revoke-keys-e2e-mt-987d6f93-dhp2x 44m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-987d6f93-dhp2x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal Started pod/maas-api-revoke-keys-e2e-mt-987d6f93-dhp2x Container started 44m Normal Created pod/maas-api-revoke-keys-e2e-mt-987d6f93-dhp2x Container created 44m Normal Completed job/maas-api-revoke-keys-e2e-mt-987d6f93 Job completed 44m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f Created pod: maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw 44m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w1-a5faaa Scaled up replica set maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f from 0 to 1 44m Warning FailedMount pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-b-w1-a5faaa-serving-cert" not found 44m Normal AddedInterface pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw Add eth0 [10.132.0.115/23] from ovn-kubernetes 44m Normal Started pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw Container started 44m Normal Pulling pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 44m Normal Pulled pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 379ms (379ms including waiting). Image size: 194581366 bytes. 44m Normal Created pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw Container created 44m Normal Killing pod/maas-api-e2e-mt-987d6f93-85d854d56d-cm6z6 Stopping container maas-api 43m Normal AddedInterface pod/maas-api-e2e-api-a-a37c29-56444d666-956qp Add eth0 [10.134.0.127/23] from ovn-kubernetes 43m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-a37c29-56444d666 Created pod: maas-api-e2e-api-a-a37c29-56444d666-956qp 43m Normal Pulling pod/maas-api-e2e-api-a-a37c29-56444d666-956qp Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 43m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-a37c29 Scaled up replica set maas-api-e2e-api-a-a37c29-56444d666 from 0 to 1 43m Normal Pulled pod/maas-api-e2e-api-a-a37c29-56444d666-956qp Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 409ms (409ms including waiting). Image size: 194581366 bytes. 43m Normal Created pod/maas-api-e2e-api-a-a37c29-56444d666-956qp Container created 43m Normal Started pod/maas-api-e2e-api-a-a37c29-56444d666-956qp Container started 43m Normal Pulling pod/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 43m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w0-e69af1-675f9d8745 Created pod: maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 43m Normal AddedInterface pod/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 Add eth0 [10.134.0.130/23] from ovn-kubernetes 43m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w0-e69af1 Scaled up replica set maas-api-e2e-shared-b-w0-e69af1-675f9d8745 from 0 to 1 43m Normal Created pod/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 Container created 43m Normal Started pod/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 Container started 43m Normal Pulled pod/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 327ms (327ms including waiting). Image size: 194581366 bytes. 42m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-c68724 Scaled up replica set maas-api-e2e-api-a-c68724-666cdcd8f5 from 0 to 1 42m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-c68724-666cdcd8f5 Created pod: maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s 42m Normal Pulling pod/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 42m Normal AddedInterface pod/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s Add eth0 [10.134.0.143/23] from ovn-kubernetes 42m Normal Pulled pod/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 440ms (440ms including waiting). Image size: 194581366 bytes. 42m Normal Created pod/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s Container created 42m Normal Started pod/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s Container started 42m Warning FailedMount pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-api-b-250992-serving-cert" not found 42m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-250992-85dbfc9959 Created pod: maas-api-e2e-api-b-250992-85dbfc9959-fppk5 42m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-250992 Scaled up replica set maas-api-e2e-api-b-250992-85dbfc9959 from 0 to 1 42m Normal Pulled pod/maas-api-revoke-sub-3d20a2db-q8w8l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 Add eth0 [10.134.0.144/23] from ovn-kubernetes 42m Normal SuccessfulCreate job/maas-api-revoke-sub-3d20a2db Created pod: maas-api-revoke-sub-3d20a2db-q8w8l 42m Normal Created pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 Container created 42m Normal Pulled pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 348ms (348ms including waiting). Image size: 194581366 bytes. 42m Normal Started pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 Container started 42m Normal AddedInterface pod/maas-api-revoke-sub-3d20a2db-q8w8l Add eth0 [10.133.0.146/23] from ovn-kubernetes 42m Normal Pulling pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 42m Normal Created pod/maas-api-revoke-sub-3d20a2db-q8w8l Container created 42m Normal Started pod/maas-api-revoke-sub-3d20a2db-q8w8l Container started 42m Normal Completed job/maas-api-revoke-sub-3d20a2db Job completed 42m Warning FailedMount pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-a-5a2c68-serving-cert" not found 42m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-5a2c68-769c5f5995 Created pod: maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 42m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-5a2c68 Scaled up replica set maas-api-e2e-inf-a-5a2c68-769c5f5995 from 0 to 1 42m Normal AddedInterface pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 Add eth0 [10.134.0.145/23] from ovn-kubernetes 42m Normal Pulling pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 42m Normal Pulled pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 396ms (396ms including waiting). Image size: 194581366 bytes. 42m Normal Created pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 Container created 42m Normal Started pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 Container started 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-a37c29-7rr5w Add eth0 [10.133.0.154/23] from ovn-kubernetes 42m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-a37c29-7rr5w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-a37c29 Created pod: maas-api-revoke-keys-e2e-api-a-a37c29-7rr5w 42m Normal Created pod/maas-api-revoke-keys-e2e-api-a-a37c29-7rr5w Container created 42m Normal Started pod/maas-api-revoke-keys-e2e-api-a-a37c29-7rr5w Container started 41m Normal Completed job/maas-api-revoke-keys-e2e-api-a-a37c29 Job completed 41m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-47a126f3 Created pod: maas-api-revoke-keys-e2e-mt-47a126f3-hhtvw 41m Normal Started pod/maas-api-revoke-keys-e2e-mt-47a126f3-hhtvw Container started 41m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-47a126f3-hhtvw Add eth0 [10.133.0.156/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-47a126f3-hhtvw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Created pod/maas-api-revoke-keys-e2e-mt-47a126f3-hhtvw Container created 41m Normal Completed job/maas-api-revoke-keys-e2e-mt-47a126f3 Job completed 41m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-b27079 Scaled up replica set maas-api-e2e-inf-a-b27079-5b788bb459 from 0 to 1 41m Normal Pulling pod/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 41m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-b27079-5b788bb459 Created pod: maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg 41m Normal AddedInterface pod/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg Add eth0 [10.132.0.117/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 358ms (358ms including waiting). Image size: 194581366 bytes. 41m Normal Created pod/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg Container created 41m Normal Started pod/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg Container started 41m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-1a771e Scaled up replica set maas-api-e2e-api-a-1a771e-d497b857f from 0 to 1 41m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-1a771e-d497b857f Created pod: maas-api-e2e-api-a-1a771e-d497b857f-njwj2 41m Normal AddedInterface pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Add eth0 [10.132.0.118/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 284ms (284ms including waiting). Image size: 194581366 bytes. 41m Warning Unhealthy pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Readiness probe failed: Get "https://10.132.0.118:8443/health": dial tcp 10.132.0.118:8443: connect: connection refused 41m Normal Created pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Container created 41m Normal Started pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Container started 41m Normal Pulled pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 297ms (297ms including waiting). Image size: 194581366 bytes. 41m Normal Pulling pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 41m Warning FailedMount pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-api-b-e1d6ff-serving-cert" not found 41m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4 Created pod: maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw 41m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-e1d6ff Scaled up replica set maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4 from 0 to 1 41m Normal AddedInterface pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw Add eth0 [10.132.0.119/23] from ovn-kubernetes 41m Normal Pulling pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 41m Normal Pulled pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 313ms (313ms including waiting). Image size: 194581366 bytes. 41m Normal Created pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw Container created 41m Normal Started pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw Container started 41m Normal SuccessfulCreate job/maas-api-revoke-sub-39af5652 Created pod: maas-api-revoke-sub-39af5652-4tcfz 41m Normal Pulled pod/maas-api-revoke-sub-39af5652-4tcfz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Created pod/maas-api-revoke-sub-39af5652-4tcfz Container created 41m Normal AddedInterface pod/maas-api-revoke-sub-39af5652-4tcfz Add eth0 [10.133.0.159/23] from ovn-kubernetes 41m Normal Started pod/maas-api-revoke-sub-39af5652-4tcfz Container started 41m Normal Completed job/maas-api-revoke-sub-39af5652 Job completed 41m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-212d76 Scaled up replica set maas-api-e2e-inf-b-212d76-64dcb5bbf from 0 to 1 41m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-212d76-64dcb5bbf Created pod: maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 41m Normal AddedInterface pod/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 Add eth0 [10.134.0.151/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 333ms (333ms including waiting). Image size: 194581366 bytes. 41m Normal Pulling pod/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 41m Normal Created pod/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 Container created 41m Normal Started pod/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 Container started 41m Normal SuccessfulCreate job/maas-api-revoke-sub-b9dc4ca1 Created pod: maas-api-revoke-sub-b9dc4ca1-97zql 41m Normal AddedInterface pod/maas-api-revoke-sub-b9dc4ca1-97zql Add eth0 [10.133.0.160/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-revoke-sub-b9dc4ca1-97zql Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Created pod/maas-api-revoke-sub-b9dc4ca1-97zql Container created 41m Normal Started pod/maas-api-revoke-sub-b9dc4ca1-97zql Container started 41m Normal Completed job/maas-api-revoke-sub-b9dc4ca1 Job completed 40m Normal Killing pod/maas-api-e2e-api-a-a37c29-56444d666-956qp Stopping container maas-api 40m Normal Killing pod/maas-api-e2e-mt-47a126f3-dc8779d86-vrm8k Stopping container maas-api 40m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-250992 Created pod: maas-api-revoke-keys-e2e-api-b-250992-qcpvx 40m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-250992-qcpvx Add eth0 [10.133.0.164/23] from ovn-kubernetes 40m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-250992-qcpvx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Created pod/maas-api-revoke-keys-e2e-api-b-250992-qcpvx Container created 40m Normal Started pod/maas-api-revoke-keys-e2e-api-b-250992-qcpvx Container started 40m Normal Completed job/maas-api-revoke-keys-e2e-api-b-250992 Job completed 40m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-c68724 Created pod: maas-api-revoke-keys-e2e-api-a-c68724-tjk8p 40m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-c68724-tjk8p Add eth0 [10.133.0.165/23] from ovn-kubernetes 40m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-c68724-tjk8p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Started pod/maas-api-revoke-keys-e2e-api-a-c68724-tjk8p Container started 40m Normal Created pod/maas-api-revoke-keys-e2e-api-a-c68724-tjk8p Container created 40m Normal Completed job/maas-api-revoke-keys-e2e-api-a-c68724 Job completed 39m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-027d32 Scaled up replica set maas-api-e2e-inf-b-027d32-5bf98c9579 from 0 to 1 39m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-027d32-5bf98c9579 Created pod: maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf 39m Warning FailedMount pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-b-027d32-serving-cert" not found 39m Normal Pulling pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 39m Normal AddedInterface pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf Add eth0 [10.134.0.155/23] from ovn-kubernetes 39m Normal Created pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf Container created 39m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-6d4cd0-6dc448ffcc Created pod: maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr 39m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-6d4cd0 Scaled up replica set maas-api-e2e-api-b-6d4cd0-6dc448ffcc from 0 to 1 39m Normal Started pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf Container started 39m Warning FailedMount pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-api-b-6d4cd0-serving-cert" not found 39m Normal Pulled pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 460ms (460ms including waiting). Image size: 194581366 bytes. 39m Normal Pulling pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 39m Normal AddedInterface pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr Add eth0 [10.134.0.156/23] from ovn-kubernetes 39m Normal Started pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr Container started 39m Normal Created pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr Container created 39m Normal Pulled pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 329ms (329ms including waiting). Image size: 194581366 bytes. 39m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-api-a-c68724 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-api-a-c68724: Operation cannot be fulfilled on endpoints "maas-api-e2e-api-a-c68724": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-api-a-c68724, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6d033811-4154-407a-afc4-7e046c6b14a8, UID in object meta: 39m Normal Killing pod/maas-api-e2e-api-a-c68724-666cdcd8f5-jcv8s Stopping container maas-api 39m Normal Killing pod/maas-api-e2e-api-b-250992-85dbfc9959-fppk5 Stopping container maas-api 39m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-e1d6ff Created pod: maas-api-revoke-keys-e2e-api-b-e1d6ff-nv5dm 39m Normal Started pod/maas-api-revoke-keys-e2e-api-b-e1d6ff-nv5dm Container started 39m Normal Created pod/maas-api-revoke-keys-e2e-api-b-e1d6ff-nv5dm Container created 39m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-e1d6ff-nv5dm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-e1d6ff-nv5dm Add eth0 [10.133.0.169/23] from ovn-kubernetes 38m Normal Completed job/maas-api-revoke-keys-e2e-api-b-e1d6ff Job completed 38m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-1a771e Created pod: maas-api-revoke-keys-e2e-api-a-1a771e-qcw6l 38m Normal Started pod/maas-api-revoke-keys-e2e-api-a-1a771e-qcw6l Container started 38m Normal Created pod/maas-api-revoke-keys-e2e-api-a-1a771e-qcw6l Container created 38m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-1a771e-qcw6l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-1a771e-qcw6l Add eth0 [10.133.0.172/23] from ovn-kubernetes 38m Normal Completed job/maas-api-revoke-keys-e2e-api-a-1a771e Job completed 38m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-3d520d Scaled up replica set maas-api-e2e-inf-a-3d520d-f84988b88 from 0 to 1 38m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-3d520d-f84988b88 Created pod: maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145 Created pod: maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-b-6d4cd0 Created job maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-inf-b-212d76-29891145 Created pod: maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs Add eth0 [10.133.0.173/23] from ovn-kubernetes 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-159cb7 Created job maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w3-ba4687 Created job maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145 Created pod: maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145 Created pod: maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs 38m Normal AddedInterface pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Add eth0 [10.132.0.122/23] from ovn-kubernetes 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-5d73b9 Created job maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-inf-b-027d32 Created job maas-api-key-cleanup-e2e-inf-b-027d32-29891145 38m Normal Pulling pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145 Created pod: maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-inf-b-027d32-29891145 Created pod: maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-a-1a771e Created job maas-api-key-cleanup-e2e-api-a-1a771e-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-1fb1c6 Created job maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145 Created pod: maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145 Created pod: maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145 Created pod: maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145 Created pod: maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145 Created pod: maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-e2e897 Created job maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w0-e69af1 Created job maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145 Created pod: maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-a-1a771e-29891145 Created pod: maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa Created job maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145 Created pod: maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n 38m Normal SuccessfulCreate job/maas-api-key-cleanup-29891145 Created pod: maas-api-key-cleanup-29891145-jkvz4 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w0-c839e5 Created job maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-e1a7f5 Created job maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145 Created pod: maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145 Created pod: maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-b-e1d6ff Created job maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145 Created pod: maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h Add eth0 [10.133.0.174/23] from ovn-kubernetes 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w6-1d454b Created job maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-inf-a-b27079 Created job maas-api-key-cleanup-e2e-inf-a-b27079-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6 Created job maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145 Created pod: maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-inf-a-b27079-29891145 Created pod: maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-inf-b-212d76 Created job maas-api-key-cleanup-e2e-inf-b-212d76-29891145 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 Add eth0 [10.134.0.164/23] from ovn-kubernetes 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145 Created pod: maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-7c933c Created job maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145 Created pod: maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-bb48ef Created job maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w6-83a98b Created job maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145 38m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145 Created pod: maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w3-25ff27 Created job maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145 38m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-inf-a-5a2c68 Created job maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145 38m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 38m Normal Pulled pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 501ms (501ms including waiting). Image size: 194581366 bytes. 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k Add eth0 [10.133.0.175/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k Add eth0 [10.133.0.178/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm Add eth0 [10.134.0.169/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x Add eth0 [10.133.0.187/23] from ovn-kubernetes 38m Normal Started pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Container started 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl Add eth0 [10.133.0.185/23] from ovn-kubernetes 38m Normal Created pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Container created 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs Add eth0 [10.133.0.179/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 Add eth0 [10.133.0.177/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr Add eth0 [10.134.0.170/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk Add eth0 [10.133.0.176/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm Add eth0 [10.134.0.167/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn Add eth0 [10.133.0.182/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 Add eth0 [10.133.0.180/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 Add eth0 [10.134.0.165/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln Add eth0 [10.133.0.181/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-29891145-jkvz4 Add eth0 [10.134.0.166/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 Add eth0 [10.133.0.183/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n Add eth0 [10.133.0.184/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z Add eth0 [10.133.0.186/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb Add eth0 [10.134.0.168/23] from ovn-kubernetes 38m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Add eth0 [10.132.0.123/23] from ovn-kubernetes 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.761s (2.761s including waiting). Image size: 107195206 bytes. 38m Warning FailedMount pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-a-50caaa-serving-cert" not found 38m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-50caaa Scaled up replica set maas-api-e2e-inf-a-50caaa-69cd9f948c from 0 to 1 38m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-50caaa-69cd9f948c Created pod: maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n 38m Normal Pulled pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 355ms (355ms including waiting). Image size: 194581366 bytes. 38m Normal AddedInterface pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n Add eth0 [10.132.0.124/23] from ovn-kubernetes 38m Normal Pulling pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 38m Normal Started pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n Container started 38m Normal Created pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n Container created 38m Normal SuccessfulCreate job/maas-api-revoke-sub-ae45e2d5 Created pod: maas-api-revoke-sub-ae45e2d5-qd85c 38m Normal Created pod/maas-api-revoke-sub-ae45e2d5-qd85c Container created 38m Normal AddedInterface pod/maas-api-revoke-sub-ae45e2d5-qd85c Add eth0 [10.133.0.188/23] from ovn-kubernetes 38m Normal Pulled pod/maas-api-revoke-sub-ae45e2d5-qd85c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-revoke-sub-ae45e2d5-qd85c Container started 38m Normal Completed job/maas-api-revoke-sub-ae45e2d5 Job completed 38m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm Container started 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 Container started 38m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm Container created 38m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 Container created 38m Normal Pulled pod/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28_odh-ai-gateway-infra(a3898df3-a7f0-42a8-b32e-410f7d3905a3) 38m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm_odh-ai-gateway-infra(5a84d6d0-10f4-4173-b4d2-cc5e4f6284b9) 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145 Deleted pod: maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145-6c2fm 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k Container started 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669_odh-ai-gateway-infra(e52efb02-e00b-427b-a546-7bbf75fb243f) 38m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 Container created 38m Normal Created pod/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs Container created 38m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn Container created 38m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn Container started 38m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn_odh-ai-gateway-infra(847b3f8f-7a5f-4aee-91af-723ed6dd162a) 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145-swb28 38m Normal Started pod/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs Container started 38m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k Container created 38m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 Container started 38m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k_odh-ai-gateway-infra(73e48146-305a-4a4d-ad82-9716e4217edd) 38m Normal Created pod/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 Container created 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 Container started 38m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 Container started 38m Normal Created pod/maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb Container created 38m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 Container created 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb Container started 38m Normal Created pod/maas-api-key-cleanup-29891145-jkvz4 Container created 38m Warning BackOff pod/maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb_odh-ai-gateway-infra(d72db2e1-6cd2-4c28-99db-393fa987ee32) 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145 Deleted pod: maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Pulled pod/maas-api-key-cleanup-29891145-jkvz4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f_odh-ai-gateway-infra(25f799b5-8331-4738-ab56-22a3ccdd8e1e) 38m Normal Started pod/maas-api-key-cleanup-29891145-jkvz4 Container started 38m Warning BackOff pod/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54_odh-ai-gateway-infra(45d242d3-81b5-4ba9-9ebf-e1589985e35e) 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145 Deleted pod: maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145-74z54 38m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w3-25ff27 Created pod: maas-api-revoke-keys-e2e-shared-a-w3-25ff27-9ccj7 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Container started 38m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f Container created 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145-mffsn 38m Warning BackOff pod/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145-wcqbs_odh-ai-gateway-infra(8784525d-7f58-438c-8634-60ea58a65ad9) 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145-pt64k 38m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w3-25ff27-9ccj7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n Container started 38m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w3-25ff27-9ccj7 Add eth0 [10.134.0.171/23] from ovn-kubernetes 38m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n Container created 38m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145-mg669 38m Normal Pulled pod/maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74_odh-ai-gateway-infra(eb964fb1-dcd1-4b94-92b6-228b40a70b80) 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln Container started 38m Normal Started pod/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm Container started 38m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145 Job has reached the specified backoff limit 38m Normal Created pod/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm Container created 38m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w0-e1a7f5 Saw completed job: maas-api-key-cleanup-e2e-worker-w0-e1a7f5-29891145, condition: Failed 38m Normal Pulled pod/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145-4kc74 38m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k_odh-ai-gateway-infra(686522e4-ef65-45fa-a0f7-6f1ae0b02baa) 38m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n_odh-ai-gateway-infra(36ed837a-ca4d-4872-a599-80791c2a885c) 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145-qzx5n 38m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145 Job has reached the specified backoff limit 38m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k Container started 38m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w3-25ff27-9ccj7 Container created 38m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr Container started 38m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w3-25ff27-9ccj7 Container started 38m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k Container created 38m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl_odh-ai-gateway-infra(564131b9-00af-497f-ab82-0079f5b02583) 38m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl Container started 38m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl Container created 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145-jms8f 38m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145, condition: Failed 38m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w6-1d454b Saw completed job: maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145, condition: Failed 38m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w1-e2dfd6-29891145 Job has reached the specified backoff limit 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w6-1d454b-29891145 Job has reached the specified backoff limit 38m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-inf-b-027d32-29891145 Deleted pod: maas-api-key-cleanup-e2e-inf-b-027d32-29891145-258wb 38m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-5d73b9 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145, condition: Failed 38m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr Container created 38m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-5d73b9-29891145 Job has reached the specified backoff limit 38m Warning BackOff pod/maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln_odh-ai-gateway-infra(dcb093cc-fd2d-4b0e-a020-acac0b6208db) 38m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w0-c839e5 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w0-c839e5-29891145, condition: Failed 38m Normal Created pod/maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h Container created 38m Normal Started pod/maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h Container started 38m Warning BackOff pod/maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h_odh-ai-gateway-infra(051a4aab-799c-43f4-837e-2d22708c4b8d) 38m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Created pod/maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln Container created 37m Normal SuccessfulDelete job/maas-api-key-cleanup-29891145 Deleted pod: maas-api-key-cleanup-29891145-jkvz4 37m Warning BackOff pod/maas-api-key-cleanup-29891145-jkvz4 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29891145-jkvz4_odh-ai-gateway-infra(29deeb45-64de-49e9-b82e-d7800486f49b) 37m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 Container started 37m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk Container created 37m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk Container started 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-inf-b-212d76-29891145 Deleted pod: maas-api-key-cleanup-e2e-inf-b-212d76-29891145-hffln 37m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 Container created 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-api-a-1a771e-29891145 Deleted pod: maas-api-key-cleanup-e2e-api-a-1a771e-29891145-2kv2h 37m Normal Created pod/maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x Container created 37m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs Container created 37m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs Container started 37m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z Container created 37m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z Container started 37m Normal Started pod/maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x Container started 37m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z_odh-ai-gateway-infra(5d9a1353-eb58-4f64-b640-2070da307f54) 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-api-a-1a771e-29891145 Job has reached the specified backoff limit 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-api-a-1a771e Saw completed job: maas-api-key-cleanup-e2e-api-a-1a771e-29891145, condition: Failed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145 Job has reached the specified backoff limit 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145-4l8gl 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-e2e897 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-e2e897-29891145, condition: Failed 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-inf-b-212d76 Saw completed job: maas-api-key-cleanup-e2e-inf-b-212d76-29891145, condition: Failed 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk 37m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145-dsmjk_odh-ai-gateway-infra(b6b8f83b-e61a-44b7-a957-e89084e4cf0e) 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-inf-b-212d76-29891145 Job has reached the specified backoff limit 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-inf-b-027d32 Saw completed job: maas-api-key-cleanup-e2e-inf-b-027d32-29891145, condition: Failed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-inf-b-027d32-29891145 Job has reached the specified backoff limit 37m Warning BackOff pod/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm_odh-ai-gateway-infra(c39e780d-215e-4914-a797-ff6ed146be2e) 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145 Deleted pod: maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145-fzmjm 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-inf-a-b27079-29891145 Deleted pod: maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x 37m Warning BackOff pod/maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-inf-a-b27079-29891145-l844x_odh-ai-gateway-infra(b3d0d8cc-f424-46bb-a336-5e212fc04df1) 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-inf-a-5a2c68 Saw completed job: maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145, condition: Failed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-inf-a-5a2c68-29891145 Job has reached the specified backoff limit 37m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145-ptcbs_odh-ai-gateway-infra(0056ad67-234a-48d0-a80d-34c323ab152f) 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145 Job has reached the specified backoff limit 37m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145-zcrlr_odh-ai-gateway-infra(05e088c0-1545-41f6-99a4-e57009628eaa) 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145-4jb8k 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-api-b-e1d6ff Saw completed job: maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145, condition: Failed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-api-b-e1d6ff-29891145 Job has reached the specified backoff limit 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-1fb1c6 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-1fb1c6-29891145, condition: Failed 37m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55_odh-ai-gateway-infra(b10af94b-58d0-4da1-9b6f-f79e47e65f09) 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29891145 Job has reached the specified backoff limit 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145-kjh55 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w3-25ff27 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145, condition: Failed 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29891145, condition: Failed 37m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145-rrl2z 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w6-83a98b Saw completed job: maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145, condition: Failed 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-7c933c Saw completed job: maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145, condition: Failed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w6-83a98b-29891145 Job has reached the specified backoff limit 37m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w3-25ff27 Job completed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-7c933c-29891145 Job has reached the specified backoff limit 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w3-25ff27-29891145 Job has reached the specified backoff limit 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145 Job has reached the specified backoff limit 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-inf-a-b27079-29891145 Job has reached the specified backoff limit 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145 Job has reached the specified backoff limit 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-inf-a-b27079 Saw completed job: maas-api-key-cleanup-e2e-inf-a-b27079-29891145, condition: Failed 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-api-b-6d4cd0 Saw completed job: maas-api-key-cleanup-e2e-api-b-6d4cd0-29891145, condition: Failed 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w0-e69af1 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w0-e69af1-29891145, condition: Failed 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w3-ba4687 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145, condition: Failed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w3-ba4687-29891145 Job has reached the specified backoff limit 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145 Job has reached the specified backoff limit 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145 Job has reached the specified backoff limit 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-bb48ef Saw completed job: maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145, condition: Failed 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w1-a5faaa Saw completed job: maas-api-key-cleanup-e2e-shared-b-w1-a5faaa-29891145, condition: Failed 37m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-bb48ef-29891145 Job has reached the specified backoff limit 37m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-159cb7 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-159cb7-29891145, condition: Failed 37m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-api-b-e1d6ff Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-api-b-e1d6ff: Operation cannot be fulfilled on endpoints "maas-api-e2e-api-b-e1d6ff": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-api-b-e1d6ff, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 130b77c8-6189-411f-90b0-f2adb456283a, UID in object meta: 37m Normal Killing pod/maas-api-e2e-api-b-e1d6ff-6f6ff6b4c4-2llmw Stopping container maas-api 37m Normal Killing pod/maas-api-e2e-api-a-1a771e-d497b857f-njwj2 Stopping container maas-api 37m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-6d4cd0 Created pod: maas-api-revoke-keys-e2e-api-b-6d4cd0-mbkvb 37m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-6d4cd0-mbkvb Add eth0 [10.133.0.189/23] from ovn-kubernetes 37m Normal Created pod/maas-api-revoke-keys-e2e-api-b-6d4cd0-mbkvb Container created 37m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-6d4cd0-mbkvb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 37m Normal Started pod/maas-api-revoke-keys-e2e-api-b-6d4cd0-mbkvb Container started 37m Normal Killing pod/maas-api-e2e-shared-a-w3-25ff27-5f5d69445c-4xqrg Stopping container maas-api 37m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-a-w3-25ff27 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-25ff27: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-a-w3-25ff27": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-25ff27, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1074f21c-c896-4d20-bdea-db9c4f7e4ba4, UID in object meta: 37m Normal Completed job/maas-api-revoke-keys-e2e-api-b-6d4cd0 Job completed 37m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w3-ba4687 Created pod: maas-api-revoke-keys-e2e-shared-b-w3-ba4687-dcsjf 37m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w3-ba4687-dcsjf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 37m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w3-ba4687-dcsjf Container started 37m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w3-ba4687-dcsjf Add eth0 [10.133.0.191/23] from ovn-kubernetes 37m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w3-ba4687-dcsjf Container created 36m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w3-ba4687 Job completed 36m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-dcb543 Scaled up replica set maas-api-e2e-inf-b-dcb543-848789ddfd from 0 to 1 36m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-dcb543-848789ddfd Created pod: maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld 36m Normal Pulled pod/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 389ms (389ms including waiting). Image size: 194581366 bytes. 36m Normal Created pod/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld Container created 36m Normal AddedInterface pod/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld Add eth0 [10.132.0.127/23] from ovn-kubernetes 36m Normal Pulling pod/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 36m Normal Started pod/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld Container started 36m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-0b0bd3 Scaled up replica set maas-api-e2e-inf-a-0b0bd3-577494fb85 from 0 to 1 36m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-0b0bd3-577494fb85 Created pod: maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c 36m Normal Pulling pod/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 36m Normal AddedInterface pod/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c Add eth0 [10.132.0.128/23] from ovn-kubernetes 36m Normal Pulled pod/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 346ms (346ms including waiting). Image size: 194581366 bytes. 36m Normal Created pod/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c Container created 36m Normal Started pod/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c Container started 36m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-954b03 Scaled up replica set maas-api-e2e-inf-b-954b03-5d548cf458 from 0 to 1 36m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-954b03-5d548cf458 Created pod: maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s 36m Normal Created pod/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s Container created 36m Normal Started pod/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s Container started 36m Normal Pulled pod/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 326ms (326ms including waiting). Image size: 194581366 bytes. 36m Normal Pulling pod/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 36m Normal AddedInterface pod/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s Add eth0 [10.132.0.129/23] from ovn-kubernetes 36m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-b-w3-ba4687 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ba4687: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-b-w3-ba4687": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ba4687, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ea56e90-bcb2-490a-a679-0954757cde98, UID in object meta: 36m Normal Killing pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Stopping container maas-api 36m Warning Unhealthy pod/maas-api-e2e-shared-b-w3-ba4687-75c45c7564-6l44c Readiness probe failed: Get "https://10.132.0.111:8443/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 36m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w3-159cb7 Created pod: maas-api-revoke-keys-e2e-worker-w3-159cb7-5mzl4 36m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w3-159cb7-5mzl4 Add eth0 [10.133.0.192/23] from ovn-kubernetes 36m Normal Started pod/maas-api-revoke-keys-e2e-worker-w3-159cb7-5mzl4 Container started 36m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w3-159cb7-5mzl4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 36m Normal Created pod/maas-api-revoke-keys-e2e-worker-w3-159cb7-5mzl4 Container created 36m Normal Completed job/maas-api-revoke-keys-e2e-worker-w3-159cb7 Job completed 35m Normal Killing pod/maas-api-e2e-api-b-6d4cd0-6dc448ffcc-tnhvr Stopping container maas-api 35m Normal SuccessfulCreate job/maas-api-revoke-sub-d889b36d Created pod: maas-api-revoke-sub-d889b36d-nkmnt 35m Normal SuccessfulCreate job/maas-api-revoke-sub-a3b76fdb Created pod: maas-api-revoke-sub-a3b76fdb-fnj72 35m Normal Pulled pod/maas-api-revoke-sub-a3b76fdb-fnj72 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal Pulled pod/maas-api-revoke-sub-d889b36d-nkmnt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal Started pod/maas-api-revoke-sub-d889b36d-nkmnt Container started 35m Normal AddedInterface pod/maas-api-revoke-sub-d889b36d-nkmnt Add eth0 [10.133.0.194/23] from ovn-kubernetes 35m Normal AddedInterface pod/maas-api-revoke-sub-a3b76fdb-fnj72 Add eth0 [10.133.0.193/23] from ovn-kubernetes 35m Normal Created pod/maas-api-revoke-sub-a3b76fdb-fnj72 Container created 35m Normal Started pod/maas-api-revoke-sub-a3b76fdb-fnj72 Container started 35m Normal Created pod/maas-api-revoke-sub-d889b36d-nkmnt Container created 35m Normal Completed job/maas-api-revoke-sub-d889b36d Job completed 35m Normal Completed job/maas-api-revoke-sub-a3b76fdb Job completed 35m Normal SuccessfulCreate job/maas-api-revoke-sub-d16ca106 Created pod: maas-api-revoke-sub-d16ca106-w5gwn 35m Normal AddedInterface pod/maas-api-revoke-sub-d16ca106-w5gwn Add eth0 [10.133.0.195/23] from ovn-kubernetes 35m Normal Pulled pod/maas-api-revoke-sub-d16ca106-w5gwn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal Created pod/maas-api-revoke-sub-d16ca106-w5gwn Container created 35m Normal Started pod/maas-api-revoke-sub-d16ca106-w5gwn Container started 35m Normal Completed job/maas-api-revoke-sub-d16ca106 Job completed 35m Normal SuccessfulCreate job/maas-api-revoke-sub-cec887dc Created pod: maas-api-revoke-sub-cec887dc-zhf55 35m Normal AddedInterface pod/maas-api-revoke-sub-cec887dc-zhf55 Add eth0 [10.133.0.199/23] from ovn-kubernetes 35m Normal Started pod/maas-api-revoke-sub-cec887dc-zhf55 Container started 35m Normal Created pod/maas-api-revoke-sub-cec887dc-zhf55 Container created 35m Normal Pulled pod/maas-api-revoke-sub-cec887dc-zhf55 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal Completed job/maas-api-revoke-sub-cec887dc Job completed 34m Normal Killing pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Stopping container maas-api 34m Warning Unhealthy pod/maas-api-e2e-worker-w3-159cb7-9bc86b759-svpn5 Readiness probe failed: Get "https://10.134.0.51:8443/health": dial tcp 10.134.0.51:8443: connect: connection refused 34m Normal Pulling pod/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-ab76d3 Scaled up replica set maas-api-e2e-inf-b-ab76d3-865b6645b8 from 0 to 1 34m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-ab76d3-865b6645b8 Created pod: maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 34m Normal AddedInterface pod/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 Add eth0 [10.134.0.183/23] from ovn-kubernetes 34m Normal Started pod/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 Container started 34m Normal Created pod/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 Container created 34m Normal Pulled pod/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 377ms (377ms including waiting). Image size: 194581366 bytes. 34m Normal AddedInterface pod/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h Add eth0 [10.132.0.130/23] from ovn-kubernetes 34m Normal Pulling pod/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 34m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-579ea7 Scaled up replica set maas-api-e2e-inf-a-579ea7-c75d488db from 0 to 1 34m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-579ea7-c75d488db Created pod: maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h 34m Normal Pulled pod/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 295ms (295ms including waiting). Image size: 194581366 bytes. 34m Normal Created pod/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h Container created 34m Normal Started pod/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h Container started 34m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-5a2c68 Created pod: maas-api-revoke-keys-e2e-inf-a-5a2c68-kjp6h 34m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-5a2c68-kjp6h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-5a2c68-kjp6h Add eth0 [10.133.0.202/23] from ovn-kubernetes 34m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-5a2c68-kjp6h Container started 34m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-5a2c68-kjp6h Container created 34m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-5a2c68 Job completed 34m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-5a2c68 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-5a2c68: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-5a2c68": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-5a2c68, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 64ca0b76-b3ed-405c-9e1c-b3f3e884327f, UID in object meta: 34m Normal Killing pod/maas-api-e2e-inf-a-5a2c68-769c5f5995-qg9c7 Stopping container maas-api 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-212d76 Created pod: maas-api-revoke-keys-e2e-inf-b-212d76-mpmns 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-212d76-mpmns Container started 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-212d76-mpmns Container created 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-212d76-mpmns Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-212d76-mpmns Add eth0 [10.133.0.203/23] from ovn-kubernetes 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-212d76 Job completed 33m Normal AddedInterface pod/maas-api-revoke-sub-ef1e077a-m2l6d Add eth0 [10.133.0.205/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-sub-ef1e077a-m2l6d Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal SuccessfulCreate job/maas-api-revoke-sub-ef1e077a Created pod: maas-api-revoke-sub-ef1e077a-m2l6d 33m Normal Created pod/maas-api-revoke-sub-ef1e077a-m2l6d Container created 33m Normal Started pod/maas-api-revoke-sub-ef1e077a-m2l6d Container started 33m Normal Completed job/maas-api-revoke-sub-ef1e077a Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-sub-62a7e053 Created pod: maas-api-revoke-sub-62a7e053-klc87 33m Normal AddedInterface pod/maas-api-revoke-sub-62a7e053-klc87 Add eth0 [10.133.0.206/23] from ovn-kubernetes 33m Normal Started pod/maas-api-revoke-sub-62a7e053-klc87 Container started 33m Normal Created pod/maas-api-revoke-sub-62a7e053-klc87 Container created 33m Normal Pulled pod/maas-api-revoke-sub-62a7e053-klc87 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Killing pod/maas-api-e2e-inf-b-212d76-64dcb5bbf-2pkf8 Stopping container maas-api 33m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-b-212d76 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-b-212d76: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-b-212d76": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-b-212d76, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1cc0390b-4527-406f-8431-8518669fec61, UID in object meta: 33m Normal Completed job/maas-api-revoke-sub-62a7e053 Job completed 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6-8ss7g Add eth0 [10.133.0.207/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6-8ss7g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6 Created pod: maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6-8ss7g 33m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6-8ss7g Container started 33m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6-8ss7g Container created 33m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-58ac21 Scaled up replica set maas-api-e2e-inf-b-58ac21-65c54689c5 from 0 to 1 33m Warning FailedMount pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-b-58ac21-serving-cert" not found 33m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-58ac21-65c54689c5 Created pod: maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck 33m Normal Pulling pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 33m Normal AddedInterface pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck Add eth0 [10.134.0.189/23] from ovn-kubernetes 33m Normal Started pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck Container started 33m Normal Pulled pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 434ms (434ms including waiting). Image size: 194581366 bytes. 33m Normal Created pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck Container created 33m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w1-e2dfd6 Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-b27079 Created pod: maas-api-revoke-keys-e2e-inf-a-b27079-h6gbj 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-b27079-h6gbj Add eth0 [10.133.0.208/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-b27079-h6gbj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-b27079-h6gbj Container created 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-b27079-h6gbj Container started 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-b27079 Job completed 32m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-b27079 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-b27079: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-b27079": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-b27079, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 737ed22d-a380-4d10-8a35-afc16c21b40d, UID in object meta: 32m Normal Killing pod/maas-api-e2e-inf-a-b27079-5b788bb459-9xrmg Stopping container maas-api 32m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-a-w1-e2dfd6 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-e2dfd6: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-a-w1-e2dfd6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-e2dfd6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 640926dc-92c3-41cc-9a77-33bfa863372e, UID in object meta: 32m Normal Killing pod/maas-api-e2e-shared-a-w1-e2dfd6-764589d498-2mrxn Stopping container maas-api 32m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-027d32 Created pod: maas-api-revoke-keys-e2e-inf-b-027d32-xs2kl 32m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-027d32-xs2kl Container created 32m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-027d32-xs2kl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-027d32-xs2kl Add eth0 [10.133.0.209/23] from ovn-kubernetes 32m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-027d32-xs2kl Container started 32m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-027d32 Job completed 32m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa Created pod: maas-api-revoke-keys-e2e-shared-b-w1-a5faaa-j2kg2 32m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa-j2kg2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa-j2kg2 Container started 32m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa-j2kg2 Add eth0 [10.133.0.210/23] from ovn-kubernetes 32m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa-j2kg2 Container created 32m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w1-a5faaa Job completed 31m Normal Killing pod/maas-api-e2e-shared-b-w1-a5faaa-7bfc88ff6f-rxllw Stopping container maas-api 31m Normal Killing pod/maas-api-e2e-inf-b-027d32-5bf98c9579-smgtf Stopping container maas-api 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w1-7c933c-759x4 Add eth0 [10.133.0.212/23] from ovn-kubernetes 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w1-7c933c Created pod: maas-api-revoke-keys-e2e-worker-w1-7c933c-759x4 31m Normal Started pod/maas-api-revoke-keys-e2e-worker-w1-7c933c-759x4 Container started 31m Normal Created pod/maas-api-revoke-keys-e2e-worker-w1-7c933c-759x4 Container created 31m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w1-7c933c-759x4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Completed job/maas-api-revoke-keys-e2e-worker-w1-7c933c Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w0-c839e5 Created pod: maas-api-revoke-keys-e2e-shared-a-w0-c839e5-s4mm4 31m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w0-c839e5-s4mm4 Container started 31m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w0-c839e5-s4mm4 Container created 31m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w0-c839e5-s4mm4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w0-c839e5-s4mm4 Add eth0 [10.133.0.213/23] from ovn-kubernetes 31m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w0-c839e5 Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-sub-9e4adbf5 Created pod: maas-api-revoke-sub-9e4adbf5-dp45p 31m Normal SuccessfulCreate job/maas-api-revoke-sub-225a1c9d Created pod: maas-api-revoke-sub-225a1c9d-tzprk 31m Normal Created pod/maas-api-revoke-sub-9e4adbf5-dp45p Container created 31m Normal Pulled pod/maas-api-revoke-sub-9e4adbf5-dp45p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-225a1c9d-tzprk Add eth0 [10.133.0.215/23] from ovn-kubernetes 31m Normal Started pod/maas-api-revoke-sub-9e4adbf5-dp45p Container started 31m Normal Started pod/maas-api-revoke-sub-225a1c9d-tzprk Container started 31m Normal Created pod/maas-api-revoke-sub-225a1c9d-tzprk Container created 31m Normal Pulled pod/maas-api-revoke-sub-225a1c9d-tzprk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-9e4adbf5-dp45p Add eth0 [10.133.0.214/23] from ovn-kubernetes 31m Normal Completed job/maas-api-revoke-sub-9e4adbf5 Job completed 31m Normal Completed job/maas-api-revoke-sub-225a1c9d Job completed 31m Normal Killing pod/maas-api-e2e-shared-a-w0-c839e5-5bc57f9865-g2hd7 Stopping container maas-api 30m Warning Unhealthy pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Readiness probe failed: Get "https://10.132.0.64:8443/health": dial tcp 10.132.0.64:8443: connect: connection refused 30m Normal Killing pod/maas-api-e2e-worker-w1-7c933c-74c99b8fd4-tx7wk Stopping container maas-api 30m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w0-e69af1-qjszk Add eth0 [10.133.0.216/23] from ovn-kubernetes 30m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w0-e69af1 Created pod: maas-api-revoke-keys-e2e-shared-b-w0-e69af1-qjszk 30m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w0-e69af1-qjszk Container created 30m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w0-e69af1-qjszk Container started 30m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w0-e69af1-qjszk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w0-e69af1 Job completed 30m Normal Killing pod/maas-api-e2e-shared-b-w0-e69af1-675f9d8745-p2jc9 Stopping container maas-api 30m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-b-w0-e69af1 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e69af1: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-b-w0-e69af1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e69af1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e3812a64-72f1-45d2-92c8-2c3e0a0bbb20, UID in object meta: 30m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w0-e1a7f5 Created pod: maas-api-revoke-keys-e2e-worker-w0-e1a7f5-fkjsn 30m Normal Started pod/maas-api-revoke-keys-e2e-worker-w0-e1a7f5-fkjsn Container started 30m Normal Created pod/maas-api-revoke-keys-e2e-worker-w0-e1a7f5-fkjsn Container created 30m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w0-e1a7f5-fkjsn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w0-e1a7f5-fkjsn Add eth0 [10.133.0.217/23] from ovn-kubernetes 30m Normal Completed job/maas-api-revoke-keys-e2e-worker-w0-e1a7f5 Job completed 30m Normal SuccessfulCreate job/maas-api-revoke-sub-b2985003 Created pod: maas-api-revoke-sub-b2985003-nqllm 30m Normal Created pod/maas-api-revoke-sub-b2985003-nqllm Container created 30m Normal Started pod/maas-api-revoke-sub-b2985003-nqllm Container started 30m Normal Pulled pod/maas-api-revoke-sub-b2985003-nqllm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-sub-b2985003-nqllm Add eth0 [10.133.0.218/23] from ovn-kubernetes 30m Normal Completed job/maas-api-revoke-sub-b2985003 Job completed 30m Normal Pulled pod/maas-api-revoke-sub-6ff20e72-gpqlm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-sub-6ff20e72-gpqlm Add eth0 [10.133.0.219/23] from ovn-kubernetes 30m Normal SuccessfulCreate job/maas-api-revoke-sub-6ff20e72 Created pod: maas-api-revoke-sub-6ff20e72-gpqlm 30m Normal Created pod/maas-api-revoke-sub-6ff20e72-gpqlm Container created 30m Normal Started pod/maas-api-revoke-sub-6ff20e72-gpqlm Container started 30m Normal Completed job/maas-api-revoke-sub-6ff20e72 Job completed 30m Normal Started pod/maas-api-revoke-sub-aaf70013-ddf82 Container started 30m Normal Created pod/maas-api-revoke-sub-aaf70013-ddf82 Container created 30m Normal AddedInterface pod/maas-api-revoke-sub-d4c5e1eb-qbrx6 Add eth0 [10.133.0.221/23] from ovn-kubernetes 30m Normal Pulled pod/maas-api-revoke-sub-d4c5e1eb-qbrx6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal SuccessfulCreate job/maas-api-revoke-sub-d4c5e1eb Created pod: maas-api-revoke-sub-d4c5e1eb-qbrx6 30m Normal AddedInterface pod/maas-api-revoke-sub-aaf70013-ddf82 Add eth0 [10.133.0.220/23] from ovn-kubernetes 30m Normal Pulled pod/maas-api-revoke-sub-aaf70013-ddf82 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal SuccessfulCreate job/maas-api-revoke-sub-aaf70013 Created pod: maas-api-revoke-sub-aaf70013-ddf82 30m Normal Created pod/maas-api-revoke-sub-d4c5e1eb-qbrx6 Container created 30m Normal Started pod/maas-api-revoke-sub-d4c5e1eb-qbrx6 Container started 30m Normal Completed job/maas-api-revoke-sub-d4c5e1eb Job completed 30m Normal Completed job/maas-api-revoke-sub-aaf70013 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-a83f8028 Created pod: maas-api-revoke-sub-a83f8028-qc4km 29m Normal Started pod/maas-api-revoke-sub-a83f8028-qc4km Container started 29m Normal Created pod/maas-api-revoke-sub-a83f8028-qc4km Container created 29m Normal Pulled pod/maas-api-revoke-sub-a83f8028-qc4km Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-sub-a83f8028-qc4km Add eth0 [10.133.0.222/23] from ovn-kubernetes 29m Normal Completed job/maas-api-revoke-sub-a83f8028 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-50caaa Created pod: maas-api-revoke-keys-e2e-inf-a-50caaa-vqvv4 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-50caaa-vqvv4 Add eth0 [10.133.0.223/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-50caaa-vqvv4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-50caaa-vqvv4 Container created 29m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-50caaa-vqvv4 Container started 29m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-50caaa Job completed 29m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-w0-e1a7f5 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-w0-e1a7f5: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-w0-e1a7f5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-w0-e1a7f5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 87a8d767-505a-4f3d-93ce-05abbd6a40b8, UID in object meta: 29m Normal Killing pod/maas-api-e2e-worker-w0-e1a7f5-65698846fd-jzmt4 Stopping container maas-api 29m Normal Created pod/maas-api-revoke-sub-eb82de51-ssmzf Container created 29m Normal Started pod/maas-api-revoke-sub-eb82de51-ssmzf Container started 29m Normal SuccessfulCreate job/maas-api-revoke-sub-eb82de51 Created pod: maas-api-revoke-sub-eb82de51-ssmzf 29m Normal AddedInterface pod/maas-api-revoke-sub-eb82de51-ssmzf Add eth0 [10.133.0.224/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-sub-eb82de51-ssmzf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Completed job/maas-api-revoke-sub-eb82de51 Job completed 29m Normal Killing pod/maas-api-e2e-inf-a-50caaa-69cd9f948c-8x87n Stopping container maas-api 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-3d520d Created pod: maas-api-revoke-keys-e2e-inf-a-3d520d-zz2sk 29m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-3d520d-zz2sk Container started 29m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-3d520d-zz2sk Container created 29m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-3d520d-zz2sk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-3d520d-zz2sk Add eth0 [10.133.0.225/23] from ovn-kubernetes 29m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-3d520d Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-954b03 Created pod: maas-api-revoke-keys-e2e-inf-b-954b03-226n4 29m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-954b03-226n4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-954b03-226n4 Add eth0 [10.133.0.226/23] from ovn-kubernetes 29m Normal SuccessfulCreate job/maas-api-revoke-sub-f5c5a703 Created pod: maas-api-revoke-sub-f5c5a703-l7m2k 29m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-954b03-226n4 Container started 29m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-954b03-226n4 Container created 28m Normal Pulled pod/maas-api-revoke-sub-f5c5a703-l7m2k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-f5c5a703-l7m2k Add eth0 [10.133.0.227/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-sub-f5c5a703-l7m2k Container started 28m Normal Created pod/maas-api-revoke-sub-f5c5a703-l7m2k Container created 28m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-954b03 Job completed 28m Normal Killing pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Stopping container maas-api 28m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-3d520d Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-3d520d: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-3d520d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-3d520d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5fed55ef-1695-4e51-bac8-778e7f48a210, UID in object meta: 28m Normal Completed job/maas-api-revoke-sub-f5c5a703 Job completed 28m Warning Unhealthy pod/maas-api-e2e-inf-a-3d520d-f84988b88-mwtkd Readiness probe failed: Get "https://10.132.0.122:8443/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Normal SuccessfulCreate job/maas-api-revoke-sub-6db36beb Created pod: maas-api-revoke-sub-6db36beb-tdq4m 28m Normal AddedInterface pod/maas-api-revoke-sub-6db36beb-tdq4m Add eth0 [10.133.0.228/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-6db36beb-tdq4m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-sub-6db36beb-tdq4m Container started 28m Normal Created pod/maas-api-revoke-sub-6db36beb-tdq4m Container created 28m Normal Completed job/maas-api-revoke-sub-6db36beb Job completed 28m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-b-954b03 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-b-954b03: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-b-954b03": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-b-954b03, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 30b9b110-c60d-41af-ab28-e7ad4546796a, UID in object meta: 28m Normal Killing pod/maas-api-e2e-inf-b-954b03-5d548cf458-m4l8s Stopping container maas-api 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-dcb543 Created pod: maas-api-revoke-keys-e2e-inf-b-dcb543-xt49w 28m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-dcb543-xt49w Container created 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-dcb543-xt49w Add eth0 [10.133.0.229/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-dcb543-xt49w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-dcb543-xt49w Container started 28m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-dcb543 Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-d0456d25 Created pod: maas-api-revoke-sub-d0456d25-4pzbs 28m Normal Pulled pod/maas-api-revoke-sub-d0456d25-4pzbs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-d0456d25-4pzbs Add eth0 [10.133.0.230/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-sub-d0456d25-4pzbs Container started 28m Normal Created pod/maas-api-revoke-sub-d0456d25-4pzbs Container created 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-0b0bd3 Created pod: maas-api-revoke-keys-e2e-inf-a-0b0bd3-7wqq5 28m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-0b0bd3-7wqq5 Container created 28m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-0b0bd3-7wqq5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-0b0bd3-7wqq5 Add eth0 [10.133.0.231/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-0b0bd3-7wqq5 Container started 28m Normal Completed job/maas-api-revoke-sub-d0456d25 Job completed 28m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-0b0bd3 Job completed 28m Normal Killing pod/maas-api-e2e-inf-b-dcb543-848789ddfd-5qqld Stopping container maas-api 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w6-83a98b Created pod: maas-api-revoke-keys-e2e-shared-a-w6-83a98b-kw2qf 28m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w6-83a98b-kw2qf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w6-83a98b-kw2qf Add eth0 [10.133.0.232/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w6-83a98b-kw2qf Container started 28m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w6-83a98b-kw2qf Container created 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w5-e2e897 Created pod: maas-api-revoke-keys-e2e-worker-w5-e2e897-pfhwn 28m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w6-83a98b Job completed 28m Normal Started pod/maas-api-revoke-keys-e2e-worker-w5-e2e897-pfhwn Container started 28m Normal Created pod/maas-api-revoke-keys-e2e-worker-w5-e2e897-pfhwn Container created 28m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w5-e2e897-pfhwn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w5-e2e897-pfhwn Add eth0 [10.133.0.233/23] from ovn-kubernetes 28m Normal SuccessfulCreate job/maas-api-revoke-sub-a83256ce Created pod: maas-api-revoke-sub-a83256ce-hm2k5 28m Normal Completed job/maas-api-revoke-keys-e2e-worker-w5-e2e897 Job completed 28m Normal Pulled pod/maas-api-revoke-sub-a83256ce-hm2k5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-a83256ce-hm2k5 Add eth0 [10.133.0.234/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-sub-a83256ce-hm2k5 Container created 28m Normal Started pod/maas-api-revoke-sub-a83256ce-hm2k5 Container started 28m Normal Killing pod/maas-api-e2e-shared-a-w6-83a98b-669dd5dc5f-jhrjj Stopping container maas-api 28m Normal Completed job/maas-api-revoke-sub-a83256ce Job completed 28m Normal Killing pod/maas-api-e2e-inf-a-0b0bd3-577494fb85-xbx9c Stopping container maas-api 28m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-0b0bd3 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0bd3: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-0b0bd3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-0b0bd3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 36a22eea-23d5-4dfe-b98d-3e7ae1dea4af, UID in object meta: 27m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-579ea7-mqxvb Container started 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-579ea7 Created pod: maas-api-revoke-keys-e2e-inf-a-579ea7-mqxvb 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-579ea7-mqxvb Add eth0 [10.133.0.235/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-579ea7-mqxvb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-579ea7-mqxvb Container created 27m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-579ea7 Job completed 27m Normal SuccessfulCreate job/maas-api-revoke-sub-ef005ddb Created pod: maas-api-revoke-sub-ef005ddb-k52p4 27m Normal SuccessfulCreate job/maas-api-revoke-sub-6abd2c5a Created pod: maas-api-revoke-sub-6abd2c5a-skl72 27m Normal Pulled pod/maas-api-revoke-sub-ef005ddb-k52p4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Started pod/maas-api-revoke-sub-ef005ddb-k52p4 Container started 27m Normal AddedInterface pod/maas-api-revoke-sub-ef005ddb-k52p4 Add eth0 [10.133.0.236/23] from ovn-kubernetes 27m Normal Created pod/maas-api-revoke-sub-ef005ddb-k52p4 Container created 27m Normal Pulled pod/maas-api-revoke-sub-6abd2c5a-skl72 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-sub-6abd2c5a-skl72 Container created 27m Normal Started pod/maas-api-revoke-sub-6abd2c5a-skl72 Container started 27m Normal AddedInterface pod/maas-api-revoke-sub-6abd2c5a-skl72 Add eth0 [10.133.0.237/23] from ovn-kubernetes 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-ab76d3 Created pod: maas-api-revoke-keys-e2e-inf-b-ab76d3-8pcwp 27m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-ab76d3-8pcwp Container created 27m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-ab76d3-8pcwp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-ab76d3-8pcwp Add eth0 [10.133.0.238/23] from ovn-kubernetes 27m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-ab76d3-8pcwp Container started 27m Normal Completed job/maas-api-revoke-sub-ef005ddb Job completed 27m Normal Completed job/maas-api-revoke-sub-6abd2c5a Job completed 27m Normal Killing pod/maas-api-e2e-inf-a-579ea7-c75d488db-5nf5h Stopping container maas-api 27m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-ab76d3 Job completed 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w6-1d454b Created pod: maas-api-revoke-keys-e2e-shared-b-w6-1d454b-9n6p2 27m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w6-1d454b-9n6p2 Container started 27m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w6-1d454b-9n6p2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w6-1d454b-9n6p2 Container created 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w6-1d454b-9n6p2 Add eth0 [10.133.0.239/23] from ovn-kubernetes 27m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w6-1d454b Job completed 27m Normal Killing pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Stopping container maas-api 27m Warning Unhealthy pod/maas-api-e2e-worker-w5-e2e897-698bd9ddb6-7mgd5 Readiness probe failed: Get "https://10.134.0.52:8443/health": dial tcp 10.134.0.52:8443: connect: connection refused 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-58ac21 Created pod: maas-api-revoke-keys-e2e-inf-b-58ac21-tdl6v 27m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-58ac21-tdl6v Container started 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-58ac21-tdl6v Add eth0 [10.133.0.240/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-58ac21-tdl6v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-58ac21-tdl6v Container created 27m Normal Killing pod/maas-api-e2e-inf-b-ab76d3-865b6645b8-559r4 Stopping container maas-api 27m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-58ac21 Job completed 27m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-b-w6-1d454b Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-1d454b: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-b-w6-1d454b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-1d454b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7c77f602-1329-41c9-8ef5-59b997535288, UID in object meta: 27m Normal Killing pod/maas-api-e2e-shared-b-w6-1d454b-69cd44b65f-fg864 Stopping container maas-api 27m Normal Killing pod/maas-api-e2e-inf-b-58ac21-65c54689c5-tfcck Stopping container maas-api 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w6-5d73b9 Created pod: maas-api-revoke-keys-e2e-worker-w6-5d73b9-crdg9 27m Normal Started pod/maas-api-revoke-keys-e2e-worker-w6-5d73b9-crdg9 Container started 27m Normal Created pod/maas-api-revoke-keys-e2e-worker-w6-5d73b9-crdg9 Container created 27m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w6-5d73b9-crdg9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w6-5d73b9-crdg9 Add eth0 [10.134.0.191/23] from ovn-kubernetes 27m Normal Completed job/maas-api-revoke-keys-e2e-worker-w6-5d73b9 Job completed 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w4-bb48ef Created pod: maas-api-revoke-keys-e2e-worker-w4-bb48ef-4rpzp 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w4-bb48ef-4rpzp Add eth0 [10.134.0.192/23] from ovn-kubernetes 27m Normal Created pod/maas-api-revoke-keys-e2e-worker-w4-bb48ef-4rpzp Container created 27m Normal Started pod/maas-api-revoke-keys-e2e-worker-w4-bb48ef-4rpzp Container started 27m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w4-bb48ef-4rpzp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Completed job/maas-api-revoke-keys-e2e-worker-w4-bb48ef Job completed 27m Normal Pulled pod/maas-api-revoke-sub-cf62fb1d-shbq4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-sub-ff16e334-6rh5x Add eth0 [10.133.0.241/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-sub-ff16e334-6rh5x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-sub-cf62fb1d-shbq4 Add eth0 [10.134.0.193/23] from ovn-kubernetes 27m Normal SuccessfulCreate job/maas-api-revoke-sub-cf62fb1d Created pod: maas-api-revoke-sub-cf62fb1d-shbq4 27m Normal SuccessfulCreate job/maas-api-revoke-sub-ff16e334 Created pod: maas-api-revoke-sub-ff16e334-6rh5x 27m Normal Started pod/maas-api-revoke-sub-ff16e334-6rh5x Container started 27m Normal Created pod/maas-api-revoke-sub-cf62fb1d-shbq4 Container created 27m Normal Started pod/maas-api-revoke-sub-cf62fb1d-shbq4 Container started 27m Normal Created pod/maas-api-revoke-sub-ff16e334-6rh5x Container created 27m Normal AddedInterface pod/maas-api-revoke-sub-ba69d71a-t848b Add eth0 [10.134.0.194/23] from ovn-kubernetes 27m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w2-1fb1c6 Created pod: maas-api-revoke-keys-e2e-worker-w2-1fb1c6-5x7b4 27m Normal Created pod/maas-api-revoke-sub-ba69d71a-t848b Container created 27m Normal SuccessfulCreate job/maas-api-revoke-sub-ba69d71a Created pod: maas-api-revoke-sub-ba69d71a-t848b 27m Normal AddedInterface pod/maas-api-revoke-sub-7fae8d51-slbd9 Add eth0 [10.133.0.242/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-sub-7fae8d51-slbd9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Pulled pod/maas-api-revoke-sub-ba69d71a-t848b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Started pod/maas-api-revoke-sub-ba69d71a-t848b Container started 27m Normal SuccessfulCreate job/maas-api-revoke-sub-7fae8d51 Created pod: maas-api-revoke-sub-7fae8d51-slbd9 27m Normal Started pod/maas-api-revoke-sub-7fae8d51-slbd9 Container started 27m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w2-1fb1c6-5x7b4 Add eth0 [10.134.0.195/23] from ovn-kubernetes 27m Normal Created pod/maas-api-revoke-sub-7fae8d51-slbd9 Container created 27m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w2-1fb1c6-5x7b4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-keys-e2e-worker-w2-1fb1c6-5x7b4 Container created 27m Normal Started pod/maas-api-revoke-keys-e2e-worker-w2-1fb1c6-5x7b4 Container started 27m Normal Completed job/maas-api-revoke-sub-cf62fb1d Job completed 27m Normal Completed job/maas-api-revoke-sub-ff16e334 Job completed 27m Normal Completed job/maas-api-revoke-sub-7fae8d51 Job completed 27m Normal Completed job/maas-api-revoke-sub-ba69d71a Job completed 27m Normal Completed job/maas-api-revoke-keys-e2e-worker-w2-1fb1c6 Job completed 26m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-w6-5d73b9 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-w6-5d73b9: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-w6-5d73b9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-w6-5d73b9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9a3cc58b-64ab-4474-8170-969c44f8b942, UID in object meta: 26m Normal Killing pod/maas-api-e2e-worker-w6-5d73b9-77c7968bf-2rqmx Stopping container maas-api 26m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-w4-bb48ef Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-w4-bb48ef: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-w4-bb48ef": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-w4-bb48ef, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b49088d7-4f13-42e8-8413-02ec7d6409ac, UID in object meta: 26m Normal Killing pod/maas-api-e2e-worker-w4-bb48ef-8f874f8b-k4pjs Stopping container maas-api 26m Normal Pulled pod/maas-api-revoke-sub-649a89e7-r76qs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Pulled pod/maas-api-revoke-sub-ce124ea8-lh729 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal AddedInterface pod/maas-api-revoke-sub-ce124ea8-lh729 Add eth0 [10.134.0.196/23] from ovn-kubernetes 26m Normal SuccessfulCreate job/maas-api-revoke-sub-649a89e7 Created pod: maas-api-revoke-sub-649a89e7-r76qs 26m Normal SuccessfulCreate job/maas-api-revoke-sub-ce124ea8 Created pod: maas-api-revoke-sub-ce124ea8-lh729 26m Normal AddedInterface pod/maas-api-revoke-sub-649a89e7-r76qs Add eth0 [10.133.0.243/23] from ovn-kubernetes 26m Normal Started pod/maas-api-revoke-sub-ce124ea8-lh729 Container started 26m Normal Created pod/maas-api-revoke-sub-649a89e7-r76qs Container created 26m Normal Started pod/maas-api-revoke-sub-649a89e7-r76qs Container started 26m Normal Created pod/maas-api-revoke-sub-ce124ea8-lh729 Container created 26m Normal Completed job/maas-api-revoke-sub-ce124ea8 Job completed 26m Normal Completed job/maas-api-revoke-sub-649a89e7 Job completed 26m Normal Killing pod/maas-api-e2e-worker-w2-1fb1c6-6659f49fbd-p7krx Stopping container maas-api 25m Normal SuccessfulCreate job/maas-api-revoke-sub-85237e45 Created pod: maas-api-revoke-sub-85237e45-gxvs6 25m Normal Started pod/maas-api-revoke-sub-85237e45-gxvs6 Container started 25m Normal Created pod/maas-api-revoke-sub-85237e45-gxvs6 Container created 25m Normal Pulled pod/maas-api-revoke-sub-85237e45-gxvs6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal AddedInterface pod/maas-api-revoke-sub-85237e45-gxvs6 Add eth0 [10.134.0.201/23] from ovn-kubernetes 25m Normal Completed job/maas-api-revoke-sub-85237e45 Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-c1e271a9 Created pod: maas-api-revoke-sub-c1e271a9-87mv4 23m Normal Started pod/maas-api-revoke-sub-c1e271a9-87mv4 Container started 23m Normal Created pod/maas-api-revoke-sub-c1e271a9-87mv4 Container created 23m Normal Pulled pod/maas-api-revoke-sub-c1e271a9-87mv4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-sub-c1e271a9-87mv4 Add eth0 [10.134.0.203/23] from ovn-kubernetes 23m Normal Completed job/maas-api-revoke-sub-c1e271a9 Job completed 23m Normal SuccessfulCreate job/maas-api-revoke-sub-2e1f5b5f Created pod: maas-api-revoke-sub-2e1f5b5f-jcdj6 23m Normal Pulled pod/maas-api-revoke-sub-2e1f5b5f-jcdj6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-sub-2e1f5b5f-jcdj6 Add eth0 [10.134.0.204/23] from ovn-kubernetes 23m Normal Created pod/maas-api-revoke-sub-2e1f5b5f-jcdj6 Container created 23m Normal Started pod/maas-api-revoke-sub-2e1f5b5f-jcdj6 Container started 23m Normal Completed job/maas-api-revoke-sub-2e1f5b5f Job completed 23m Normal AddedInterface pod/maas-api-key-cleanup-29891160-g9lth Add eth0 [10.134.0.205/23] from ovn-kubernetes 23m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29891160 23m Normal SuccessfulCreate job/maas-api-key-cleanup-29891160 Created pod: maas-api-key-cleanup-29891160-g9lth 23m Normal AddedInterface pod/maas-api-revoke-sub-ec843018-57cd5 Add eth0 [10.133.0.244/23] from ovn-kubernetes 23m Normal Pulled pod/maas-api-revoke-sub-ec843018-57cd5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal SuccessfulCreate job/maas-api-revoke-sub-ec843018 Created pod: maas-api-revoke-sub-ec843018-57cd5 23m Normal Started pod/maas-api-revoke-sub-ec843018-57cd5 Container started 23m Normal Created pod/maas-api-revoke-sub-ec843018-57cd5 Container created 23m Normal Completed job/maas-api-revoke-sub-ec843018 Job completed 23m Normal Pulled pod/maas-api-key-cleanup-29891160-g9lth Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Started pod/maas-api-key-cleanup-29891160-g9lth Container started 23m Normal Created pod/maas-api-key-cleanup-29891160-g9lth Container created 23m Warning BackOff pod/maas-api-key-cleanup-29891160-g9lth Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29891160-g9lth_odh-ai-gateway-infra(c605ff03-f2c0-4810-8c61-44beca17179c) 23m Normal SuccessfulDelete job/maas-api-key-cleanup-29891160 Deleted pod: maas-api-key-cleanup-29891160-g9lth 22m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29891160 Job has reached the specified backoff limit 22m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29891160, condition: Failed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-046e1343 Created pod: maas-api-revoke-sub-046e1343-7t7mv 22m Normal Pulled pod/maas-api-revoke-sub-046e1343-7t7mv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal AddedInterface pod/maas-api-revoke-sub-046e1343-7t7mv Add eth0 [10.134.0.206/23] from ovn-kubernetes 22m Normal Created pod/maas-api-revoke-sub-046e1343-7t7mv Container created 22m Normal Started pod/maas-api-revoke-sub-046e1343-7t7mv Container started 22m Normal Completed job/maas-api-revoke-sub-046e1343 Job completed 22m Normal AddedInterface pod/maas-api-revoke-sub-d3fba056-7xfkb Add eth0 [10.134.0.207/23] from ovn-kubernetes 22m Normal SuccessfulCreate job/maas-api-revoke-sub-d3fba056 Created pod: maas-api-revoke-sub-d3fba056-7xfkb 22m Normal Pulled pod/maas-api-revoke-sub-d3fba056-7xfkb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-d3fba056-7xfkb Container created 22m Normal Started pod/maas-api-revoke-sub-d3fba056-7xfkb Container started 22m Normal Completed job/maas-api-revoke-sub-d3fba056 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-ae594979 Created pod: maas-api-revoke-sub-ae594979-xhh9k 21m Normal AddedInterface pod/maas-api-revoke-sub-ae594979-xhh9k Add eth0 [10.134.0.208/23] from ovn-kubernetes 21m Normal Pulled pod/maas-api-revoke-sub-ae594979-xhh9k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-sub-ae594979-xhh9k Container created 21m Normal Started pod/maas-api-revoke-sub-ae594979-xhh9k Container started 21m Normal Completed job/maas-api-revoke-sub-ae594979 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-a4aef7d7 Created pod: maas-api-revoke-sub-a4aef7d7-kqc6w 21m Normal AddedInterface pod/maas-api-revoke-sub-a4aef7d7-kqc6w Add eth0 [10.134.0.209/23] from ovn-kubernetes 21m Normal Pulled pod/maas-api-revoke-sub-a4aef7d7-kqc6w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-sub-a4aef7d7-kqc6w Container created 21m Normal Started pod/maas-api-revoke-sub-a4aef7d7-kqc6w Container started 21m Normal Completed job/maas-api-revoke-sub-a4aef7d7 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-sub-79805ca9 Created pod: maas-api-revoke-sub-79805ca9-5477h 21m Normal AddedInterface pod/maas-api-revoke-sub-79805ca9-5477h Add eth0 [10.134.0.210/23] from ovn-kubernetes 21m Normal Started pod/maas-api-revoke-sub-79805ca9-5477h Container started 21m Normal Created pod/maas-api-revoke-sub-79805ca9-5477h Container created 21m Normal Pulled pod/maas-api-revoke-sub-79805ca9-5477h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Completed job/maas-api-revoke-sub-79805ca9 Job completed 20m Normal AddedInterface pod/maas-api-revoke-sub-0b7e8edb-2j575 Add eth0 [10.134.0.211/23] from ovn-kubernetes 20m Normal Pulled pod/maas-api-revoke-sub-0b7e8edb-2j575 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal SuccessfulCreate job/maas-api-revoke-sub-0b7e8edb Created pod: maas-api-revoke-sub-0b7e8edb-2j575 20m Normal Created pod/maas-api-revoke-sub-0b7e8edb-2j575 Container created 20m Normal Started pod/maas-api-revoke-sub-0b7e8edb-2j575 Container started 20m Normal Completed job/maas-api-revoke-sub-0b7e8edb Job completed 20m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-5p4hg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-5p4hg 20m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-5p4hg Add eth0 [10.134.0.212/23] from ovn-kubernetes 20m Normal Created pod/maas-api-revoke-sub-3d4156f1-5p4hg Container created 20m Normal Started pod/maas-api-revoke-sub-3d4156f1-5p4hg Container started 20m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 20m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-tvxdk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-tvxdk 20m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-tvxdk Add eth0 [10.134.0.213/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-sub-3d4156f1-tvxdk Container started 20m Normal Created pod/maas-api-revoke-sub-3d4156f1-tvxdk Container created 20m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 19m Normal Pulled pod/maas-api-revoke-sub-e2fc9c5b-6rlpt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal SuccessfulCreate job/maas-api-revoke-sub-e2fc9c5b Created pod: maas-api-revoke-sub-e2fc9c5b-6rlpt 19m Normal AddedInterface pod/maas-api-revoke-sub-e2fc9c5b-6rlpt Add eth0 [10.134.0.214/23] from ovn-kubernetes 19m Normal Started pod/maas-api-revoke-sub-e2fc9c5b-6rlpt Container started 19m Normal Created pod/maas-api-revoke-sub-e2fc9c5b-6rlpt Container created 19m Normal Completed job/maas-api-revoke-sub-e2fc9c5b Job completed 19m Normal SuccessfulCreate job/maas-api-revoke-sub-5a29efb3 Created pod: maas-api-revoke-sub-5a29efb3-2qmt7 19m Normal AddedInterface pod/maas-api-revoke-sub-5a29efb3-2qmt7 Add eth0 [10.134.0.215/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-revoke-sub-5a29efb3-2qmt7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Created pod/maas-api-revoke-sub-5a29efb3-2qmt7 Container created 19m Normal Started pod/maas-api-revoke-sub-5a29efb3-2qmt7 Container started 19m Normal Completed job/maas-api-revoke-sub-5a29efb3 Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-jjng4 18m Normal Started pod/maas-api-revoke-sub-3d4156f1-jjng4 Container started 18m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-jjng4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Created pod/maas-api-revoke-sub-3d4156f1-jjng4 Container created 18m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-jjng4 Add eth0 [10.134.0.216/23] from ovn-kubernetes 18m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 18m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-c51413-66d8b59c59 Created pod: maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 18m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-c51413 Scaled up replica set maas-api-e2e-worker-single-main-c51413-66d8b59c59 from 0 to 1 18m Normal AddedInterface pod/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 Add eth0 [10.132.0.134/23] from ovn-kubernetes 18m Normal Created pod/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 Container created 18m Normal Started pod/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 Container started 18m Normal Pulled pod/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 393ms (393ms including waiting). Image size: 194581366 bytes. 18m Normal Pulling pod/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 17m Normal SuccessfulCreate job/maas-api-revoke-sub-b154f532 Created pod: maas-api-revoke-sub-b154f532-8zf5q 17m Normal Started pod/maas-api-revoke-sub-b154f532-8zf5q Container started 17m Normal Pulled pod/maas-api-revoke-sub-b154f532-8zf5q Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Created pod/maas-api-revoke-sub-b154f532-8zf5q Container created 17m Normal AddedInterface pod/maas-api-revoke-sub-b154f532-8zf5q Add eth0 [10.134.0.220/23] from ovn-kubernetes 17m Normal Completed job/maas-api-revoke-sub-b154f532 Job completed 17m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-c51413-vhpk7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-c51413-vhpk7 Add eth0 [10.134.0.221/23] from ovn-kubernetes 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-c51413 Created pod: maas-api-revoke-keys-e2e-worker-single-main-c51413-vhpk7 17m Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-c51413-vhpk7 Container started 17m Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-c51413-vhpk7 Container created 17m Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-c51413 Job completed 17m Normal Killing pod/maas-api-e2e-worker-single-main-c51413-66d8b59c59-m5gc7 Stopping container maas-api 17m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-single-main-c51413 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c51413: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-single-main-c51413": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c51413, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a07656fb-0a15-4ffd-8c93-783dfcb5ffb0, UID in object meta: 17m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-hndgq 17m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-hndgq Add eth0 [10.134.0.222/23] from ovn-kubernetes 17m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-hndgq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Created pod/maas-api-revoke-sub-3d4156f1-hndgq Container created 17m Normal Started pod/maas-api-revoke-sub-3d4156f1-hndgq Container started 17m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 14m Normal SuccessfulCreate job/maas-api-revoke-sub-d576e68b Created pod: maas-api-revoke-sub-d576e68b-zwxxc 14m Normal Pulled pod/maas-api-revoke-sub-d576e68b-zwxxc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal AddedInterface pod/maas-api-revoke-sub-d576e68b-zwxxc Add eth0 [10.134.0.223/23] from ovn-kubernetes 14m Normal Created pod/maas-api-revoke-sub-d576e68b-zwxxc Container created 14m Normal Started pod/maas-api-revoke-sub-d576e68b-zwxxc Container started 14m Normal Completed job/maas-api-revoke-sub-d576e68b Job completed 14m Normal SuccessfulCreate job/maas-api-revoke-sub-d2bc93bc Created pod: maas-api-revoke-sub-d2bc93bc-wr2x2 14m Normal AddedInterface pod/maas-api-revoke-sub-d2bc93bc-wr2x2 Add eth0 [10.134.0.224/23] from ovn-kubernetes 14m Normal Started pod/maas-api-revoke-sub-d2bc93bc-wr2x2 Container started 14m Normal Created pod/maas-api-revoke-sub-d2bc93bc-wr2x2 Container created 14m Normal Pulled pod/maas-api-revoke-sub-d2bc93bc-wr2x2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal Completed job/maas-api-revoke-sub-d2bc93bc Job completed 13m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75 Created pod: maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q 13m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-88d1c3 Scaled up replica set maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75 from 0 to 1 13m Warning FailedMount pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-single-main-88d1c3-serving-cert" not found 13m Normal Pulled pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 531ms (531ms including waiting). Image size: 194581366 bytes. 13m Normal Pulling pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 13m Normal AddedInterface pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Add eth0 [10.132.0.137/23] from ovn-kubernetes 13m Normal Started pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Container started 13m Normal Created pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Container created 12m Normal AddedInterface pod/maas-api-revoke-sub-1b5f8846-x9mtn Add eth0 [10.134.0.228/23] from ovn-kubernetes 12m Normal Pulled pod/maas-api-revoke-sub-1b5f8846-x9mtn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal SuccessfulCreate job/maas-api-revoke-sub-1b5f8846 Created pod: maas-api-revoke-sub-1b5f8846-x9mtn 12m Normal Created pod/maas-api-revoke-sub-1b5f8846-x9mtn Container created 12m Normal Started pod/maas-api-revoke-sub-1b5f8846-x9mtn Container started 12m Normal Completed job/maas-api-revoke-sub-1b5f8846 Job completed 12m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-88d1c3-z8drg Add eth0 [10.134.0.229/23] from ovn-kubernetes 12m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-88d1c3 Created pod: maas-api-revoke-keys-e2e-worker-single-main-88d1c3-z8drg 12m Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-88d1c3-z8drg Container started 12m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-88d1c3-z8drg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-88d1c3-z8drg Container created 12m Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-88d1c3 Job completed 12m Warning Unhealthy pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Readiness probe failed: Get "https://10.132.0.137:8443/health": dial tcp 10.132.0.137:8443: connect: connection refused 12m Normal Killing pod/maas-api-e2e-worker-single-main-88d1c3-86c9bf5b75-pf77q Stopping container maas-api 11m Normal SuccessfulCreate job/maas-api-revoke-sub-452b6d7b Created pod: maas-api-revoke-sub-452b6d7b-655cv 11m Normal Pulled pod/maas-api-revoke-sub-452b6d7b-655cv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal AddedInterface pod/maas-api-revoke-sub-452b6d7b-655cv Add eth0 [10.134.0.230/23] from ovn-kubernetes 11m Normal Started pod/maas-api-revoke-sub-452b6d7b-655cv Container started 11m Normal Created pod/maas-api-revoke-sub-452b6d7b-655cv Container created 11m Normal Completed job/maas-api-revoke-sub-452b6d7b Job completed 11m Normal SuccessfulCreate job/maas-api-revoke-sub-3e31a506 Created pod: maas-api-revoke-sub-3e31a506-fqlnm 11m Normal AddedInterface pod/maas-api-revoke-sub-3e31a506-fqlnm Add eth0 [10.134.0.231/23] from ovn-kubernetes 11m Normal Pulled pod/maas-api-revoke-sub-3e31a506-fqlnm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal Created pod/maas-api-revoke-sub-3e31a506-fqlnm Container created 11m Normal Started pod/maas-api-revoke-sub-3e31a506-fqlnm Container started 11m Normal Completed job/maas-api-revoke-sub-3e31a506 Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-34987b0e Created pod: maas-api-revoke-sub-34987b0e-4w2pq 10m Normal Pulled pod/maas-api-revoke-sub-34987b0e-4w2pq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal AddedInterface pod/maas-api-revoke-sub-34987b0e-4w2pq Add eth0 [10.134.0.232/23] from ovn-kubernetes 10m Normal Started pod/maas-api-revoke-sub-34987b0e-4w2pq Container started 10m Normal Created pod/maas-api-revoke-sub-34987b0e-4w2pq Container created 10m Normal Completed job/maas-api-revoke-sub-34987b0e Job completed 10m Normal AddedInterface pod/maas-api-77b4f5466-46jwt Add eth0 [10.132.0.141/23] from ovn-kubernetes 10m Normal SuccessfulCreate replicaset/maas-api-77b4f5466 Created pod: maas-api-77b4f5466-46jwt 10m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-77b4f5466 from 0 to 1 10m Normal AddedInterface pod/maas-api-58c87df8db-qp7ps Add eth0 [10.134.0.233/23] from ovn-kubernetes 10m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-58c87df8db from 1 to 2 10m Normal Pulling pod/maas-api-58c87df8db-qp7ps Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal Pulling pod/maas-api-77b4f5466-46jwt Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal SuccessfulCreate replicaset/maas-api-58c87df8db Created pod: maas-api-58c87df8db-qp7ps 10m Normal Pulled pod/maas-api-58c87df8db-qp7ps Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 415ms (415ms including waiting). Image size: 194581366 bytes. 10m Normal Pulled pod/maas-api-77b4f5466-46jwt Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 355ms (355ms including waiting). Image size: 194581366 bytes. 10m Normal Created pod/maas-api-77b4f5466-46jwt Container created 10m Normal Started pod/maas-api-77b4f5466-46jwt Container started 10m Normal Created pod/maas-api-58c87df8db-qp7ps Container created 10m Normal Started pod/maas-api-58c87df8db-qp7ps Container started 10m Normal SuccessfulDelete replicaset/maas-api-58c87df8db Deleted pod: maas-api-58c87df8db-cqkxd 10m Normal Pulling pod/maas-api-77b4f5466-tlq6k Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal AddedInterface pod/maas-api-77b4f5466-tlq6k Add eth0 [10.134.0.235/23] from ovn-kubernetes 10m Normal SuccessfulCreate replicaset/maas-api-77b4f5466 Created pod: maas-api-77b4f5466-tlq6k 10m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-58c87df8db from 2 to 1 10m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-77b4f5466 from 1 to 2 10m Normal Killing pod/maas-api-58c87df8db-cqkxd Stopping container maas-api 10m Normal Created pod/maas-api-77b4f5466-tlq6k Container created 10m Normal Started pod/maas-api-77b4f5466-tlq6k Container started 10m Normal Pulled pod/maas-api-77b4f5466-tlq6k Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 307ms (307ms including waiting). Image size: 194581366 bytes. 10m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-77f48536 Scaled up replica set maas-api-e2e-ait-77f48536-f6d5599f from 0 to 1 10m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-77f48536-f6d5599f Created pod: maas-api-e2e-ait-77f48536-f6d5599f-r27sq 10m Warning FailedMount pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-77f48536-serving-cert" not found 10m Normal AddedInterface pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq Add eth0 [10.132.0.144/23] from ovn-kubernetes 10m Normal Pulling pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 10m Normal Created pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq Container created 10m Normal Started pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq Container started 10m Normal Pulled pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 270ms (270ms including waiting). Image size: 194581366 bytes. 10m Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-58c87df8db from 1 to 0 10m Normal Killing pod/maas-api-58c87df8db-qp7ps Stopping container maas-api 10m Normal SuccessfulDelete replicaset/maas-api-58c87df8db Deleted pod: maas-api-58c87df8db-qp7ps 10m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-77f48536 Created pod: maas-api-revoke-keys-e2e-ait-77f48536-52m6m 10m Warning FailedMount pod/maas-api-revoke-keys-e2e-ait-77f48536-52m6m MountVolume.SetUp failed for volume "kube-api-access-q4hmz" : failed to fetch token: serviceaccounts "maas-api-cleanup" not found 10m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-77f48536-52m6m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal Started pod/maas-api-revoke-keys-e2e-ait-77f48536-52m6m Container started 10m Normal Created pod/maas-api-revoke-keys-e2e-ait-77f48536-52m6m Container created 10m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-77f48536-52m6m Add eth0 [10.133.0.245/23] from ovn-kubernetes 10m Warning FailedToRetrieveImagePullSecret pod/maas-api-revoke-keys-e2e-ait-77f48536-52m6m Unable to retrieve some image pull secrets (maas-api-cleanup-dockercfg-nvgg5); attempting to pull the image may not succeed. 10m Normal Completed job/maas-api-revoke-keys-e2e-ait-77f48536 Job completed 9m57s Normal Killing pod/maas-api-e2e-ait-77f48536-f6d5599f-r27sq Stopping container maas-api 9m57s Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ait-77f48536 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ait-77f48536: Operation cannot be fulfilled on endpoints "maas-api-e2e-ait-77f48536": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ait-77f48536, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0116a967-7bdf-4b44-bdc1-35c690f7dace, UID in object meta: 9m44s Normal SuccessfulCreate replicaset/maas-api-e2e-authcfg-http-95ffa8-d66545987 Created pod: maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd 9m44s Normal ScalingReplicaSet deployment/maas-api-e2e-authcfg-http-95ffa8 Scaled up replica set maas-api-e2e-authcfg-http-95ffa8-d66545987 from 0 to 1 9m43s Normal AddedInterface pod/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd Add eth0 [10.132.0.145/23] from ovn-kubernetes 9m43s Normal Pulled pod/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd Successfully pulled image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" in 349ms (349ms including waiting). Image size: 194581366 bytes. 9m43s Normal Pulling pod/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd Pulling image "quay.io/opendatahub/maas-api:7879675aa66d002425c7b32375d6d0156eaa0c56" 9m42s Normal Started pod/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd Container started 9m42s Normal Created pod/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd Container created 8m19s Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-authcfg-http-95ffa8 Created job maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175 8m19s Normal AddedInterface pod/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt Add eth0 [10.133.0.246/23] from ovn-kubernetes 8m19s Normal SuccessfulCreate job/maas-api-key-cleanup-29891175 Created pod: maas-api-key-cleanup-29891175-4ss7k 8m19s Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175 Created pod: maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt 8m19s Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29891175 8m19s Normal AddedInterface pod/maas-api-key-cleanup-29891175-4ss7k Add eth0 [10.134.0.239/23] from ovn-kubernetes 8m9s Normal Pulled pod/maas-api-revoke-keys-e2e-authcfg-http-95ffa8-wnfxx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m9s Normal AddedInterface pod/maas-api-revoke-keys-e2e-authcfg-http-95ffa8-wnfxx Add eth0 [10.133.0.247/23] from ovn-kubernetes 8m9s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-authcfg-http-95ffa8 Created pod: maas-api-revoke-keys-e2e-authcfg-http-95ffa8-wnfxx 8m8s Normal Created pod/maas-api-revoke-keys-e2e-authcfg-http-95ffa8-wnfxx Container created 8m8s Normal Started pod/maas-api-revoke-keys-e2e-authcfg-http-95ffa8-wnfxx Container started 8m6s Normal Pulled pod/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m6s Normal Created pod/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt Container created 8m6s Normal Started pod/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt Container started 8m5s Normal Created pod/maas-api-key-cleanup-29891175-4ss7k Container created 8m5s Normal Started pod/maas-api-key-cleanup-29891175-4ss7k Container started 8m5s Warning BackOff pod/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt_odh-ai-gateway-infra(485f3ef8-a6e8-4f67-8d7a-20a185f7cc79) 8m5s Normal Completed job/maas-api-revoke-keys-e2e-authcfg-http-95ffa8 Job completed 8m5s Normal Pulled pod/maas-api-key-cleanup-29891175-4ss7k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m4s Normal SuccessfulDelete job/maas-api-key-cleanup-29891175 Deleted pod: maas-api-key-cleanup-29891175-4ss7k 8m4s Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175 Deleted pod: maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175-v2rwt 8m4s Warning BackOff pod/maas-api-key-cleanup-29891175-4ss7k Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29891175-4ss7k_odh-ai-gateway-infra(edbdcd3a-0c36-4ff7-b1c5-81e2fd86113a) 8m2s Normal SuccessfulDelete cronjob/maas-api-key-cleanup Deleted job maas-api-key-cleanup-29891130 8m2s Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29891175, condition: Failed 8m2s Warning BackoffLimitExceeded job/maas-api-key-cleanup-29891175 Job has reached the specified backoff limit 8m2s Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-authcfg-http-95ffa8 Saw completed job: maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175, condition: Failed 8m2s Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-authcfg-http-95ffa8-29891175 Job has reached the specified backoff limit 7m53s Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-authcfg-http-95ffa8 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-authcfg-http-95ffa8: Operation cannot be fulfilled on endpoints "maas-api-e2e-authcfg-http-95ffa8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-authcfg-http-95ffa8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: faba6085-bb8a-40a3-9228-e7e4061740df, UID in object meta: 7m53s Normal Killing pod/maas-api-e2e-authcfg-http-95ffa8-d66545987-h44gd Stopping container maas-api 7m17s Normal Pulled pod/maas-api-revoke-sub-f03629db-skz5w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 7m17s Normal AddedInterface pod/maas-api-revoke-sub-f03629db-skz5w Add eth0 [10.133.0.248/23] from ovn-kubernetes 7m17s Normal SuccessfulCreate job/maas-api-revoke-sub-f03629db Created pod: maas-api-revoke-sub-f03629db-skz5w 7m16s Normal Created pod/maas-api-revoke-sub-f03629db-skz5w Container created 7m16s Normal Started pod/maas-api-revoke-sub-f03629db-skz5w Container started 7m13s Normal Completed job/maas-api-revoke-sub-f03629db Job completed 7m Normal SuccessfulCreate job/maas-api-revoke-sub-0165d7d2 Created pod: maas-api-revoke-sub-0165d7d2-4b58h 7m Normal AddedInterface pod/maas-api-revoke-sub-0165d7d2-4b58h Add eth0 [10.133.0.249/23] from ovn-kubernetes 7m Normal Pulled pod/maas-api-revoke-sub-0165d7d2-4b58h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 6m59s Normal Started pod/maas-api-revoke-sub-0165d7d2-4b58h Container started 6m59s Normal Created pod/maas-api-revoke-sub-0165d7d2-4b58h Container created 6m56s Normal Completed job/maas-api-revoke-sub-0165d7d2 Job completed 6m49s Normal Pulled pod/maas-api-revoke-sub-6b19338f-gsmgn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 6m49s Normal SuccessfulCreate job/maas-api-revoke-sub-6b19338f Created pod: maas-api-revoke-sub-6b19338f-gsmgn 6m49s Normal Started pod/maas-api-revoke-sub-6b19338f-gsmgn Container started 6m49s Normal Created pod/maas-api-revoke-sub-6b19338f-gsmgn Container created 6m49s Normal AddedInterface pod/maas-api-revoke-sub-6b19338f-gsmgn Add eth0 [10.133.0.250/23] from ovn-kubernetes 6m45s Normal Completed job/maas-api-revoke-sub-6b19338f Job completed