=== events in odh-ai-gateway-infra (2026-10-30T06:41:26Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 38m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-f78ca5-2hq4x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f78ca5-2hq4x to ip-10-0-136-35.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-709c4831-4qwgl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-709c4831-4qwgl to ip-10-0-136-35.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w to ip-10-0-138-15.ec2.internal 2m11s Normal Scheduled pod/maas-api-revoke-sub-0165d7d2-ssltj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-ssltj to ip-10-0-136-173.ec2.internal 47m Normal Scheduled pod/maas-api-revoke-sub-01d8a893-xptcl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-01d8a893-xptcl to ip-10-0-136-35.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-022c89b8-dn9jf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-022c89b8-dn9jf to ip-10-0-136-35.ec2.internal 2m40s Normal Scheduled pod/maas-api-595cc648c-gmtg7 Successfully assigned odh-ai-gateway-infra/maas-api-595cc648c-gmtg7 to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w5-a35835-gd9hf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-a35835-gd9hf to ip-10-0-136-35.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w4-e2e3d0-z7xhj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-e2e3d0-z7xhj to ip-10-0-136-35.ec2.internal 59m Normal Scheduled pod/postgres-7cdbf6dc44-p64x4 Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-p64x4 to ip-10-0-138-15.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w3-128436-vqhw8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-128436-vqhw8 to ip-10-0-136-35.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w2-c78066-2vqlt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-c78066-2vqlt to ip-10-0-136-35.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w1-4a68a1-7lct7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-4a68a1-7lct7 to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w0-197e9b-qpbhk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-197e9b-qpbhk to ip-10-0-136-35.ec2.internal 2m47s Normal Scheduled pod/maas-api-5c48877c75-2pbs6 Successfully assigned odh-ai-gateway-infra/maas-api-5c48877c75-2pbs6 to ip-10-0-136-35.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 to ip-10-0-138-15.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-046e1343-5xrlr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-5xrlr to ip-10-0-136-35.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-05036bc6-gv94s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-05036bc6-gv94s to ip-10-0-136-35.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-fa02d109-gjphw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fa02d109-gjphw to ip-10-0-136-35.ec2.internal 2m23s Normal Scheduled pod/maas-api-revoke-sub-f03629db-mmvdq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-mmvdq to ip-10-0-136-173.ec2.internal 4m38s Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-ee1c63-g7zn9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-ee1c63-g7zn9 to ip-10-0-136-173.ec2.internal 58m Normal Scheduled pod/maas-api-5c48877c75-skq9m Successfully assigned odh-ai-gateway-infra/maas-api-5c48877c75-skq9m to ip-10-0-138-15.ec2.internal 8m7s Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-6c0c09-2qqzl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-6c0c09-2qqzl to ip-10-0-136-173.ec2.internal 31m Normal Scheduled pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w6-f22a52-45jdc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w6-f22a52-45jdc to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w5-91f42c-zqklm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-91f42c-zqklm to ip-10-0-136-35.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3-xfkb5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3-xfkb5 to ip-10-0-136-173.ec2.internal 27m Normal Scheduled pod/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m to ip-10-0-136-173.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-0690fdaf-kg8xn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0690fdaf-kg8xn to ip-10-0-136-35.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-0b7e8edb-pz4qf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-pz4qf to ip-10-0-136-35.ec2.internal 2m59s Normal Scheduled pod/maas-api-revoke-sub-0c3684cc-fxtdm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0c3684cc-fxtdm to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-0eb6584f-29682 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0eb6584f-29682 to ip-10-0-136-35.ec2.internal 44m Normal Scheduled pod/maas-api-revoke-sub-1135c258-llwn6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1135c258-llwn6 to ip-10-0-136-35.ec2.internal 49m Normal Scheduled pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-709c4831-57686c497f-nkbfw to ip-10-0-136-173.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr to ip-10-0-136-173.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-eef45f53-984js Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-eef45f53-984js to ip-10-0-136-35.ec2.internal 39m Normal Scheduled pod/maas-api-revoke-sub-edde6690-qj8wv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-edde6690-qj8wv to ip-10-0-136-35.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-ec843018-h7nh8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-h7nh8 to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-ea494249-qbvcp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ea494249-qbvcp to ip-10-0-136-35.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-e9a9d6b1-q97pz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e9a9d6b1-q97pz to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-133fe481-sktzm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-133fe481-sktzm to ip-10-0-136-35.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb-9zzx2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb-9zzx2 to ip-10-0-136-35.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w2-f6302c-xbx85 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f6302c-xbx85 to ip-10-0-136-35.ec2.internal 30m Normal Scheduled pod/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb to ip-10-0-136-35.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 to ip-10-0-138-15.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w1-0f980e-4sph5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-0f980e-4sph5 to ip-10-0-136-35.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w0-03d349-k5nbw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w0-03d349-k5nbw to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-e8c9dbc3-s46qd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e8c9dbc3-s46qd to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w6-477f6b-xzhsb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w6-477f6b-xzhsb to ip-10-0-136-35.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce-4nfkw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce-4nfkw to ip-10-0-136-35.ec2.internal 39m Normal Scheduled pod/maas-api-revoke-sub-13b4d176-846c2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-13b4d176-846c2 to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-14fa4301-kk5lv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-14fa4301-kk5lv to ip-10-0-136-35.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-168ced75-rrqtz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-168ced75-rrqtz to ip-10-0-136-35.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk to ip-10-0-136-173.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w4-815776-s65vs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w4-815776-s65vs to ip-10-0-136-35.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-e81cc108-7wkd7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e81cc108-7wkd7 to ip-10-0-136-35.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-e66adadd-ql562 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e66adadd-ql562 to ip-10-0-136-35.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-e4325a71-9tzsn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e4325a71-9tzsn to ip-10-0-136-35.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-e4187f4a-fsxs5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e4187f4a-fsxs5 to ip-10-0-136-35.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-e0d15423-7sqkp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e0d15423-7sqkp to ip-10-0-136-35.ec2.internal 45m Normal Preempted pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Preempted by pod 6792a38e-911d-4406-8c1a-30bf2bbfddb8 on node ip-10-0-136-173.ec2.internal 35m Normal Scheduled pod/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb to ip-10-0-136-173.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Warning FailedScheduling pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 to ip-10-0-136-35.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 to ip-10-0-136-173.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e-d7v58 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e-d7v58 to ip-10-0-136-35.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w2-25d881-zv5bg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-25d881-zv5bg to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w1-24db22-kcnfh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-24db22-kcnfh to ip-10-0-136-35.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f-5r4vw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f-5r4vw to ip-10-0-136-35.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-e055c622-82sp9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e055c622-82sp9 to ip-10-0-136-35.ec2.internal 35m Normal Scheduled pod/maas-api-revoke-sub-db9e71ee-bxccw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-db9e71ee-bxccw to ip-10-0-136-35.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-sub-db02f378-2kmsp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-db02f378-2kmsp to ip-10-0-136-35.ec2.internal 5m58s Normal Scheduled pod/maas-api-revoke-sub-d576e68b-p985h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-p985h to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 to ip-10-0-136-35.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-d3fba056-8wm79 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-8wm79 to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-d3917d7c-25tgd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3917d7c-25tgd to ip-10-0-136-35.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-1805ecc1-8bkvv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1805ecc1-8bkvv to ip-10-0-136-35.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-1b14588b-f69sl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1b14588b-f69sl to ip-10-0-136-35.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk to ip-10-0-138-15.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-a3efab09-xmw9z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3efab09-xmw9z to ip-10-0-136-173.ec2.internal 44m Normal Scheduled pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl to ip-10-0-136-35.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl to ip-10-0-138-15.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv to ip-10-0-136-173.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-d3872f64-wjb5s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3872f64-wjb5s to ip-10-0-136-35.ec2.internal 44m Warning FailedScheduling pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 45m Warning FailedScheduling pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 45m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4mzdz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b2243ef-4mzdz to ip-10-0-136-35.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4jwf7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b2243ef-4jwf7 to ip-10-0-136-173.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-keys-e2e-migrate-54d4943b-kkzrq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-54d4943b-kkzrq to ip-10-0-136-35.ec2.internal 45m Normal Preempted pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Preempted by pod 6792a38e-911d-4406-8c1a-30bf2bbfddb8 on node ip-10-0-136-173.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-f7ad21-kxmfc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7ad21-kxmfc to ip-10-0-136-35.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Warning FailedScheduling pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf to ip-10-0-136-35.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-d3805d87-9vc66 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3805d87-9vc66 to ip-10-0-136-35.ec2.internal 5m41s Normal Scheduled pod/maas-api-revoke-sub-d2bc93bc-4lcmj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-4lcmj to ip-10-0-136-35.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw to ip-10-0-136-173.ec2.internal 55m Normal Scheduled pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn to ip-10-0-136-173.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-1c771a3e-qx6bk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1c771a3e-qx6bk to ip-10-0-136-35.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx to ip-10-0-136-173.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-202061a5-q5mr5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-202061a5-q5mr5 to ip-10-0-136-35.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-d51cd8-gxf62 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d51cd8-gxf62 to ip-10-0-138-15.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-d0aae7c2-2jh7z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d0aae7c2-2jh7z to ip-10-0-136-35.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-cb1505f7-hmxdq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cb1505f7-hmxdq to ip-10-0-136-35.ec2.internal 46m Warning FailedScheduling pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Warning FailedScheduling pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj to ip-10-0-136-35.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-630fdf-c58b4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-630fdf-c58b4 to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-5deb36-4qhbz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5deb36-4qhbz to ip-10-0-136-35.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 to ip-10-0-136-35.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-2d4576-vx6ns Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2d4576-vx6ns to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-dfc3d2-zjzqb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dfc3d2-zjzqb to ip-10-0-136-35.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-dddc53-tqvvf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dddc53-tqvvf to ip-10-0-136-35.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-c8360874-ph9p2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c8360874-ph9p2 to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-c761b88d-6v9xg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c761b88d-6v9xg to ip-10-0-136-35.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-sub-264cef08-7b7h5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-264cef08-7b7h5 to ip-10-0-136-35.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Warning FailedScheduling pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-28004554-hf7p5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-28004554-hf7p5 to ip-10-0-136-35.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-2878804e-dgzbm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2878804e-dgzbm to ip-10-0-136-35.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-2b915f7f-vnj54 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2b915f7f-vnj54 to ip-10-0-136-35.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp to ip-10-0-138-15.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-db0540-2cvtj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-db0540-2cvtj to ip-10-0-136-35.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-c69d5760-jkfcx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c69d5760-jkfcx to ip-10-0-136-35.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-c610016d-vmpjd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c610016d-vmpjd to ip-10-0-136-35.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-sub-c4a6368c-r62mq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c4a6368c-r62mq to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-c3de0bdc-hwfw4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c3de0bdc-hwfw4 to ip-10-0-136-35.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 to ip-10-0-136-35.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-sub-c3562a41-cq24s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c3562a41-cq24s to ip-10-0-136-173.ec2.internal 49m Normal Scheduled pod/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr Successfully assigned odh-ai-gateway-infra/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr to ip-10-0-138-15.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-bf87e1-mf6fs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bf87e1-mf6fs to ip-10-0-136-35.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-1685dd-tfmp2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1685dd-tfmp2 to ip-10-0-136-35.ec2.internal 37m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-de7242-l7dhk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de7242-l7dhk to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 to ip-10-0-136-173.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-c54211-84h88 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c54211-84h88 to ip-10-0-136-35.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-c28447a3-8skr5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c28447a3-8skr5 to ip-10-0-136-35.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-c1e271a9-kq2vv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kq2vv to ip-10-0-136-35.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 to ip-10-0-138-15.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-2bea5546-69mm8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2bea5546-69mm8 to ip-10-0-136-35.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-7ad9ad-dwj8b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7ad9ad-dwj8b to ip-10-0-136-35.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-62316c-bbmf4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-62316c-bbmf4 to ip-10-0-136-35.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-3cc570-npbgx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3cc570-npbgx to ip-10-0-136-35.ec2.internal 24m Normal Scheduled pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks to ip-10-0-138-15.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-0d64c9-xfb8l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d64c9-xfb8l to ip-10-0-136-35.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-c1ce8661-896xd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c1ce8661-896xd to ip-10-0-136-35.ec2.internal 43m Normal Scheduled pod/maas-api-revoke-sub-c06f23b7-sgwb5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c06f23b7-sgwb5 to ip-10-0-136-173.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd to ip-10-0-138-15.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-bc55c08a-ggvwk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bc55c08a-ggvwk to ip-10-0-136-35.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-sub-bb936e39-kgpvn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bb936e39-kgpvn to ip-10-0-136-35.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-0d0152-pz92k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0d0152-pz92k to ip-10-0-136-35.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-f4e35c-lskhq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f4e35c-lskhq to ip-10-0-136-35.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n to ip-10-0-136-173.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-2e17309f-w8gqt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2e17309f-w8gqt to ip-10-0-136-35.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-2e1f5b5f-q5tb6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-q5tb6 to ip-10-0-136-35.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-3021f688-c24k7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3021f688-c24k7 to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-b395cac9-d6qpk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b395cac9-d6qpk to ip-10-0-136-35.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 to ip-10-0-136-173.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-b0e3355f-rsv2l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b0e3355f-rsv2l to ip-10-0-136-35.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-af2bc828-67vg5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-af2bc828-67vg5 to ip-10-0-136-35.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-ae594979-kwqmx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-kwqmx to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-revoke-sub-ae0f0b17-pntds Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae0f0b17-pntds to ip-10-0-136-35.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-acf0c297-wv27m Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-acf0c297-wv27m to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-d3e7e6-j6jz8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d3e7e6-j6jz8 to ip-10-0-136-35.ec2.internal 25m Normal Scheduled pod/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj to ip-10-0-136-173.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-c1d09f-z6mtv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c1d09f-z6mtv to ip-10-0-136-35.ec2.internal 22m Normal Scheduled pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 to ip-10-0-136-173.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Warning FailedScheduling pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh to ip-10-0-136-35.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-aee070-48g9r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aee070-48g9r to ip-10-0-136-35.ec2.internal 38m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-862dc2-6zzgb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-862dc2-6zzgb to ip-10-0-136-35.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-a6ec72c1-57zxh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a6ec72c1-57zxh to ip-10-0-136-35.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-a5a6380f-9shx7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a5a6380f-9shx7 to ip-10-0-136-35.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-a4aef7d7-ljcw4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-ljcw4 to ip-10-0-136-35.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-a2d9b776-jmtdc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a2d9b776-jmtdc to ip-10-0-136-35.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd to ip-10-0-138-15.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-7df9fa-bl5dz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7df9fa-bl5dz to ip-10-0-136-35.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-325a4b2e-q7jng Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-325a4b2e-q7jng to ip-10-0-136-35.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb to ip-10-0-138-15.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-343574e2-zk87f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-343574e2-zk87f to ip-10-0-136-35.ec2.internal 56m Normal Scheduled pod/maas-api-key-cleanup-29888985-gvwzf Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29888985-gvwzf to ip-10-0-136-35.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-sub-35f05329-9mcg2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-35f05329-9mcg2 to ip-10-0-136-35.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-9d1e101f-dsvhd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9d1e101f-dsvhd to ip-10-0-136-35.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-36f3c7aa-hzxkd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-36f3c7aa-hzxkd to ip-10-0-136-35.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-sub-37ae9cd8-zlt86 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-37ae9cd8-zlt86 to ip-10-0-136-35.ec2.internal 17m Normal Scheduled pod/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 to ip-10-0-136-35.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-3c520a6f-2lrht Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3c520a6f-2lrht to ip-10-0-136-35.ec2.internal 5m25s Normal Scheduled pod/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f to ip-10-0-136-35.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj to ip-10-0-138-15.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-3c8a7907-j5pm2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3c8a7907-j5pm2 to ip-10-0-136-35.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-7d8586d8-fc75x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7d8586d8-fc75x to ip-10-0-136-35.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-96df05fe-q98v8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-96df05fe-q98v8 to ip-10-0-136-35.ec2.internal 9m25s Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-9xczs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9xczs to ip-10-0-136-35.ec2.internal 9m49s Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-d6xdn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-d6xdn to ip-10-0-136-35.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-pgmj9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pgmj9 to ip-10-0-136-35.ec2.internal 7m46s Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-qd9fz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qd9fz to ip-10-0-136-35.ec2.internal 3m22s Normal Scheduled pod/maas-api-revoke-sub-3e31a506-b2wgz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-b2wgz to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-40a76272-5k7p6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-40a76272-5k7p6 to ip-10-0-136-35.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-968d7f55-8pws8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-968d7f55-8pws8 to ip-10-0-136-35.ec2.internal 35m Normal Scheduled pod/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 to ip-10-0-136-173.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-95eb23c9-q95d4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-95eb23c9-q95d4 to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-9155c284-wwq45 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9155c284-wwq45 to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-8df2ee44-54j84 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8df2ee44-54j84 to ip-10-0-136-35.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-8c2c519e-57b45 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8c2c519e-57b45 to ip-10-0-136-35.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-89c98f1e-rr5k8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-89c98f1e-rr5k8 to ip-10-0-136-35.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-sub-88df6884-pqffg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-88df6884-pqffg to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-43dfbf61-mvd4w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-43dfbf61-mvd4w to ip-10-0-136-35.ec2.internal 22m Normal Scheduled pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk to ip-10-0-136-173.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-43f71aef-n4w8d Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-43f71aef-n4w8d to ip-10-0-136-35.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv to ip-10-0-136-35.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-387b16-6pd8s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-387b16-6pd8s to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-29889000-lkffl Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29889000-lkffl to ip-10-0-138-15.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-29889015-tlp2q Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29889015-tlp2q to ip-10-0-138-15.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-88c73b74-f8d7p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-88c73b74-f8d7p to ip-10-0-136-35.ec2.internal 4m49s Normal Scheduled pod/maas-api-revoke-sub-88c0edca-4svrf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-88c0edca-4svrf to ip-10-0-136-173.ec2.internal 13m Normal Scheduled pod/maas-api-revoke-sub-85237e45-92lt2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-92lt2 to ip-10-0-136-35.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-sub-83ed428d-7mlcp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-83ed428d-7mlcp to ip-10-0-136-35.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-sub-7ee8e44e-5d72f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7ee8e44e-5d72f to ip-10-0-136-35.ec2.internal 34m Normal Scheduled pod/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 to ip-10-0-136-173.ec2.internal 11m Normal Scheduled pod/maas-api-key-cleanup-29889030-kvrng Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29889030-kvrng to ip-10-0-136-173.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t to ip-10-0-136-35.ec2.internal 8m58s Normal Scheduled pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj to ip-10-0-136-173.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk to ip-10-0-138-15.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch to ip-10-0-136-35.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-7e81b3e0-m65cg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7e81b3e0-m65cg to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 to ip-10-0-136-173.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-keys-e2e-derive-e2a1565f-tr4qx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e2a1565f-tr4qx to ip-10-0-136-35.ec2.internal 37m Normal Scheduled pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz to ip-10-0-136-35.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w6-1354a5-9x69s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-1354a5-9x69s to ip-10-0-136-35.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-b202a0-gpsrs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b202a0-gpsrs to ip-10-0-136-173.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q to ip-10-0-138-15.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-4fc75f-s4pg5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4fc75f-s4pg5 to ip-10-0-136-173.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-9b23add5-ms2rj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9b23add5-ms2rj to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-4431ec71-rs2h4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4431ec71-rs2h4 to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-79b306a9-sgx9q Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79b306a9-sgx9q to ip-10-0-136-35.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-79805ca9-j8wv2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-j8wv2 to ip-10-0-136-35.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-790f8f63-nlzc6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-790f8f63-nlzc6 to ip-10-0-136-35.ec2.internal 45m Normal Preempted pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Preempted by pod 6792a38e-911d-4406-8c1a-30bf2bbfddb8 on node ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt to ip-10-0-136-35.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w to ip-10-0-138-15.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz to ip-10-0-136-35.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-763e519d-dmntp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-763e519d-dmntp to ip-10-0-136-35.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-74d02af5-7ch6l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-74d02af5-7ch6l to ip-10-0-136-35.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk to ip-10-0-138-15.ec2.internal 38m Warning FailedScheduling pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 37m Warning FailedScheduling pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 37m Normal Scheduled pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 to ip-10-0-136-35.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-71ab8229-n277g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-71ab8229-n277g to ip-10-0-136-35.ec2.internal 27m Normal Scheduled pod/maas-api-revoke-sub-70f0ecbd-qks5j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-70f0ecbd-qks5j to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp to ip-10-0-136-35.ec2.internal 44m Normal Scheduled pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt to ip-10-0-136-173.ec2.internal 44m Warning FailedScheduling pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Warning FailedScheduling pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Warning FailedScheduling pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Normal Scheduled pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 to ip-10-0-136-173.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 to ip-10-0-138-15.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-6be5590e-kkcjf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6be5590e-kkcjf to ip-10-0-136-35.ec2.internal 2m Normal Scheduled pod/maas-api-revoke-sub-6b19338f-wttpl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-wttpl to ip-10-0-136-173.ec2.internal 8m18s Normal Scheduled pod/maas-api-revoke-sub-6a85919a-zkgkq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6a85919a-zkgkq to ip-10-0-136-173.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn to ip-10-0-136-173.ec2.internal 38m Warning FailedScheduling pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Warning FailedScheduling pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 38m Normal Scheduled pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll to ip-10-0-136-173.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-6a49ea64-cmt6t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6a49ea64-cmt6t to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-6a043a72-fk9j5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6a043a72-fk9j5 to ip-10-0-136-35.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-680f1658-h6tpx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-680f1658-h6tpx to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw to ip-10-0-138-15.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp to ip-10-0-138-15.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww to ip-10-0-136-35.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-60c04f47-phxjt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-60c04f47-phxjt to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k to ip-10-0-136-35.ec2.internal 18m Normal Scheduled pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb to ip-10-0-138-15.ec2.internal 44m Normal Scheduled pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 to ip-10-0-136-35.ec2.internal 44m Warning FailedScheduling pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 50m Normal Scheduled pod/maas-api-revoke-sub-5f50b80f-fsf5t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5f50b80f-fsf5t to ip-10-0-136-35.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-5efbc29c-vxsl9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5efbc29c-vxsl9 to ip-10-0-136-35.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-5e8c249a-f96w8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5e8c249a-f96w8 to ip-10-0-136-35.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg to ip-10-0-138-15.ec2.internal 45m Normal Preempted pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Preempted by pod 6792a38e-911d-4406-8c1a-30bf2bbfddb8 on node ip-10-0-136-173.ec2.internal 25m Normal Scheduled pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv to ip-10-0-138-15.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b to ip-10-0-138-15.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-58c83b18-dn8qc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-58c83b18-dn8qc to ip-10-0-136-35.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-51398201-cwfkf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-51398201-cwfkf to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 to ip-10-0-136-35.ec2.internal 41m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk to ip-10-0-136-173.ec2.internal 26m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm to ip-10-0-136-35.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm to ip-10-0-136-173.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-449bb3e2-vffs2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-449bb3e2-vffs2 to ip-10-0-136-35.ec2.internal 26m Normal Scheduled pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk to ip-10-0-136-173.ec2.internal 28m Normal Scheduled pod/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 to ip-10-0-136-173.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-4d689555-rtgqn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4d689555-rtgqn to ip-10-0-136-35.ec2.internal 3m40s Normal Scheduled pod/maas-api-revoke-sub-452b6d7b-nzv9h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-nzv9h to ip-10-0-136-35.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-sub-45ce7185-dzxd2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-45ce7185-dzxd2 to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-461da871-67j5m Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-461da871-67j5m to ip-10-0-136-35.ec2.internal 2m47s Normal Scheduled pod/maas-api-595cc648c-f87h8 Successfully assigned odh-ai-gateway-infra/maas-api-595cc648c-f87h8 to ip-10-0-138-15.ec2.internal 25m Normal Scheduled pod/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx to ip-10-0-138-15.ec2.internal 44m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 to ip-10-0-136-35.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-4c8328ad-4sdr8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4c8328ad-4sdr8 to ip-10-0-136-35.ec2.internal 27m Normal Scheduled pod/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 to ip-10-0-136-173.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-sub-4a9918b1-gnddj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4a9918b1-gnddj to ip-10-0-136-35.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-sub-7b24fc33-j79bn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7b24fc33-j79bn to ip-10-0-136-35.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-a095fc35-v4vnq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a095fc35-v4vnq to ip-10-0-136-35.ec2.internal 44m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-3571f8-q526k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3571f8-q526k to ip-10-0-136-173.ec2.internal 39m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-84dc9d-xm4sp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-84dc9d-xm4sp to ip-10-0-136-173.ec2.internal 43m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-9hf2b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d4ccc5-9hf2b to ip-10-0-136-35.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-466e6410-lgf5v Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-466e6410-lgf5v to ip-10-0-136-35.ec2.internal 59m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 59m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-p64x4 59m Normal Pulling pod/postgres-7cdbf6dc44-p64x4 Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 59m Normal AddedInterface pod/postgres-7cdbf6dc44-p64x4 Add eth0 [10.134.0.25/23] from ovn-kubernetes 59m Normal Started pod/postgres-7cdbf6dc44-p64x4 Container started 59m Normal Created pod/postgres-7cdbf6dc44-p64x4 Container created 59m Normal Pulled pod/postgres-7cdbf6dc44-p64x4 Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 4.769s (4.769s including waiting). Image size: 403732742 bytes. 58m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-5c48877c75 from 0 to 1 58m Warning FailedCreate replicaset/maas-api-5c48877c75 Error creating: pods "maas-api-5c48877c75-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 58m Normal SuccessfulCreate replicaset/maas-api-5c48877c75 Created pod: maas-api-5c48877c75-skq9m 58m Normal Pulling pod/maas-api-5c48877c75-skq9m Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 58m Normal AddedInterface pod/maas-api-5c48877c75-skq9m Add eth0 [10.134.0.27/23] from ovn-kubernetes 58m Normal Pulled pod/maas-api-5c48877c75-skq9m Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 2.629s (2.629s including waiting). Image size: 194510193 bytes. 58m Normal Created pod/maas-api-5c48877c75-skq9m Container created 58m Normal Started pod/maas-api-5c48877c75-skq9m Container started 56m Normal Pulling pod/maas-api-key-cleanup-29888985-gvwzf Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 56m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29888985 56m Normal SuccessfulCreate job/maas-api-key-cleanup-29888985 Created pod: maas-api-key-cleanup-29888985-gvwzf 56m Normal AddedInterface pod/maas-api-key-cleanup-29888985-gvwzf Add eth0 [10.133.0.45/23] from ovn-kubernetes 56m Normal Pulled pod/maas-api-key-cleanup-29888985-gvwzf Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.005s (2.005s including waiting). Image size: 107195206 bytes. 56m Normal AddedInterface pod/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp Add eth0 [10.134.0.39/23] from ovn-kubernetes 56m Normal Pulling pod/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-c78066-5fb6dcf77b Created pod: maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-c78066 Scaled up replica set maas-api-e2e-worker-w2-c78066-5fb6dcf77b from 0 to 1 56m Normal Created pod/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp Container created 56m Normal Pulled pod/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 377ms (377ms including waiting). Image size: 194510193 bytes. 56m Normal Started pod/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp Container started 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-197e9b Scaled up replica set maas-api-e2e-worker-w0-197e9b-6c9f984757 from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-197e9b-6c9f984757 Created pod: maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd 56m Normal Created pod/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd Container created 56m Normal Pulled pod/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 356ms (356ms including waiting). Image size: 194510193 bytes. 56m Normal Pulling pod/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal AddedInterface pod/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd Add eth0 [10.134.0.40/23] from ovn-kubernetes 56m Normal Started pod/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd Container started 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-a35835-77d7f7496d Created pod: maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-a35835 Scaled up replica set maas-api-e2e-worker-w5-a35835-77d7f7496d from 0 to 1 56m Normal Pulling pod/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal AddedInterface pod/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr Add eth0 [10.132.0.57/23] from ovn-kubernetes 56m Normal Started pod/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr Container started 56m Normal Created pod/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr Container created 56m Normal Pulled pod/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 1.382s (1.382s including waiting). Image size: 194510193 bytes. 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-e2e3d0 Scaled up replica set maas-api-e2e-worker-w4-e2e3d0-66c774896c from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-e2e3d0-66c774896c Created pod: maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk 56m Normal Created pod/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk Container created 56m Normal Pulled pod/maas-api-key-cleanup-29888985-gvwzf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 56m Normal AddedInterface pod/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk Add eth0 [10.134.0.43/23] from ovn-kubernetes 56m Normal Pulling pod/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal Pulled pod/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 369ms (369ms including waiting). Image size: 194510193 bytes. 56m Normal Started pod/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk Container started 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8 Created pod: maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n 56m Normal Created pod/maas-api-key-cleanup-29888985-gvwzf Container created 56m Normal Started pod/maas-api-key-cleanup-29888985-gvwzf Container started 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-4a68a1 Scaled up replica set maas-api-e2e-worker-w1-4a68a1-574f9c8cc8 from 0 to 1 56m Normal Started pod/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n Container started 56m Warning BackOff pod/maas-api-key-cleanup-29888985-gvwzf Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29888985-gvwzf_odh-ai-gateway-infra(abbdec48-c0b0-4e11-b870-88f7ef54538b) 56m Normal Created pod/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n Container created 56m Normal Pulled pod/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 331ms (331ms including waiting). Image size: 194510193 bytes. 56m Normal AddedInterface pod/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n Add eth0 [10.132.0.58/23] from ovn-kubernetes 56m Normal Pulling pod/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal SuccessfulDelete job/maas-api-key-cleanup-29888985 Deleted pod: maas-api-key-cleanup-29888985-gvwzf 56m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29888985, condition: Failed 56m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29888985 Job has reached the specified backoff limit 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c Created pod: maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-1354a5 Scaled up replica set maas-api-e2e-worker-w6-1354a5-6d4fc55f9c from 0 to 1 56m Warning FailedMount pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w6-1354a5-serving-cert" not found 56m Normal AddedInterface pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl Add eth0 [10.134.0.44/23] from ovn-kubernetes 56m Normal Created pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl Container created 56m Normal Pulling pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-128436 Scaled up replica set maas-api-e2e-worker-w3-128436-767b6d9869 from 0 to 1 56m Normal Pulled pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 281ms (281ms including waiting). Image size: 194510193 bytes. 56m Warning FailedMount pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w3-128436-serving-cert" not found 56m Normal Started pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl Container started 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-128436-767b6d9869 Created pod: maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn 55m Normal Pulling pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 55m Normal AddedInterface pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Add eth0 [10.132.0.59/23] from ovn-kubernetes 55m Normal Pulled pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 354ms (354ms including waiting). Image size: 194510193 bytes. 55m Normal Created pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Container created 55m Normal Started pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Container started 54m Normal SuccessfulCreate job/maas-api-revoke-sub-c8360874 Created pod: maas-api-revoke-sub-c8360874-ph9p2 54m Normal Pulled pod/maas-api-revoke-sub-c8360874-ph9p2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-c8360874-ph9p2 Add eth0 [10.133.0.67/23] from ovn-kubernetes 54m Normal Started pod/maas-api-revoke-sub-c8360874-ph9p2 Container started 54m Normal Created pod/maas-api-revoke-sub-c8360874-ph9p2 Container created 54m Normal Completed job/maas-api-revoke-sub-c8360874 Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-968d7f55 Created pod: maas-api-revoke-sub-968d7f55-8pws8 54m Normal Pulled pod/maas-api-revoke-sub-968d7f55-8pws8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-968d7f55-8pws8 Add eth0 [10.133.0.69/23] from ovn-kubernetes 54m Normal Started pod/maas-api-revoke-sub-968d7f55-8pws8 Container started 54m Normal Created pod/maas-api-revoke-sub-968d7f55-8pws8 Container created 54m Normal SuccessfulCreate job/maas-api-revoke-sub-1c771a3e Created pod: maas-api-revoke-sub-1c771a3e-qx6bk 54m Normal Pulled pod/maas-api-revoke-sub-1c771a3e-qx6bk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal SuccessfulCreate job/maas-api-revoke-sub-fa02d109 Created pod: maas-api-revoke-sub-fa02d109-gjphw 54m Normal AddedInterface pod/maas-api-revoke-sub-fa02d109-gjphw Add eth0 [10.133.0.71/23] from ovn-kubernetes 54m Normal AddedInterface pod/maas-api-revoke-sub-1c771a3e-qx6bk Add eth0 [10.133.0.70/23] from ovn-kubernetes 54m Normal Created pod/maas-api-revoke-sub-1c771a3e-qx6bk Container created 54m Normal Started pod/maas-api-revoke-sub-1c771a3e-qx6bk Container started 54m Normal Started pod/maas-api-revoke-sub-fa02d109-gjphw Container started 54m Normal Created pod/maas-api-revoke-sub-fa02d109-gjphw Container created 54m Normal Pulled pod/maas-api-revoke-sub-fa02d109-gjphw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Completed job/maas-api-revoke-sub-968d7f55 Job completed 54m Normal Completed job/maas-api-revoke-sub-fa02d109 Job completed 54m Normal Completed job/maas-api-revoke-sub-1c771a3e Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-449bb3e2 Created pod: maas-api-revoke-sub-449bb3e2-vffs2 54m Normal AddedInterface pod/maas-api-revoke-sub-449bb3e2-vffs2 Add eth0 [10.133.0.72/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-449bb3e2-vffs2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-449bb3e2-vffs2 Container created 54m Normal Started pod/maas-api-revoke-sub-449bb3e2-vffs2 Container started 54m Normal SuccessfulCreate job/maas-api-revoke-sub-e055c622 Created pod: maas-api-revoke-sub-e055c622-82sp9 54m Normal AddedInterface pod/maas-api-revoke-sub-e055c622-82sp9 Add eth0 [10.133.0.74/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-e055c622-82sp9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-e055c622-82sp9 Container created 54m Normal Started pod/maas-api-revoke-sub-e055c622-82sp9 Container started 54m Normal SuccessfulCreate job/maas-api-revoke-sub-e81cc108 Created pod: maas-api-revoke-sub-e81cc108-7wkd7 54m Normal SuccessfulCreate job/maas-api-revoke-sub-c28447a3 Created pod: maas-api-revoke-sub-c28447a3-8skr5 54m Normal Pulled pod/maas-api-revoke-sub-e81cc108-7wkd7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-c28447a3-8skr5 Add eth0 [10.133.0.75/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-c28447a3-8skr5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Completed job/maas-api-revoke-sub-449bb3e2 Job completed 54m Normal AddedInterface pod/maas-api-revoke-sub-e81cc108-7wkd7 Add eth0 [10.133.0.76/23] from ovn-kubernetes 54m Normal Completed job/maas-api-revoke-sub-e055c622 Job completed 54m Normal Created pod/maas-api-revoke-sub-c28447a3-8skr5 Container created 54m Normal Created pod/maas-api-revoke-sub-e81cc108-7wkd7 Container created 54m Normal Started pod/maas-api-revoke-sub-c28447a3-8skr5 Container started 54m Normal Started pod/maas-api-revoke-sub-e81cc108-7wkd7 Container started 54m Normal Pulled pod/maas-api-revoke-sub-4c8328ad-4sdr8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal SuccessfulCreate job/maas-api-revoke-sub-4c8328ad Created pod: maas-api-revoke-sub-4c8328ad-4sdr8 54m Normal AddedInterface pod/maas-api-revoke-sub-4c8328ad-4sdr8 Add eth0 [10.133.0.77/23] from ovn-kubernetes 53m Normal Created pod/maas-api-revoke-sub-4c8328ad-4sdr8 Container created 53m Normal Started pod/maas-api-revoke-sub-4c8328ad-4sdr8 Container started 53m Normal Completed job/maas-api-revoke-sub-c28447a3 Job completed 53m Normal Completed job/maas-api-revoke-sub-e81cc108 Job completed 53m Normal Completed job/maas-api-revoke-sub-4c8328ad Job completed 53m Normal SuccessfulCreate job/maas-api-revoke-sub-7d8586d8 Created pod: maas-api-revoke-sub-7d8586d8-fc75x 53m Normal Started pod/maas-api-revoke-sub-7d8586d8-fc75x Container started 53m Normal AddedInterface pod/maas-api-revoke-sub-7d8586d8-fc75x Add eth0 [10.133.0.78/23] from ovn-kubernetes 53m Normal Created pod/maas-api-revoke-sub-7d8586d8-fc75x Container created 53m Normal Pulled pod/maas-api-revoke-sub-7d8586d8-fc75x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Started pod/maas-api-revoke-sub-a6ec72c1-57zxh Container started 53m Normal SuccessfulCreate job/maas-api-revoke-sub-a6ec72c1 Created pod: maas-api-revoke-sub-a6ec72c1-57zxh 53m Normal Created pod/maas-api-revoke-sub-a6ec72c1-57zxh Container created 53m Normal Pulled pod/maas-api-revoke-sub-a6ec72c1-57zxh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/maas-api-revoke-sub-a6ec72c1-57zxh Add eth0 [10.133.0.79/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-revoke-sub-9d1e101f Created pod: maas-api-revoke-sub-9d1e101f-dsvhd 53m Normal Completed job/maas-api-revoke-sub-7d8586d8 Job completed 53m Normal Pulled pod/maas-api-revoke-sub-9d1e101f-dsvhd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Completed job/maas-api-revoke-sub-a6ec72c1 Job completed 53m Normal Started pod/maas-api-revoke-sub-9d1e101f-dsvhd Container started 53m Normal Created pod/maas-api-revoke-sub-9d1e101f-dsvhd Container created 53m Normal AddedInterface pod/maas-api-revoke-sub-9d1e101f-dsvhd Add eth0 [10.133.0.80/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-revoke-sub-6a49ea64 Created pod: maas-api-revoke-sub-6a49ea64-cmt6t 53m Normal AddedInterface pod/maas-api-revoke-sub-6a49ea64-cmt6t Add eth0 [10.133.0.82/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-revoke-sub-7e81b3e0 Created pod: maas-api-revoke-sub-7e81b3e0-m65cg 53m Normal Pulled pod/maas-api-revoke-sub-6a49ea64-cmt6t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Created pod/maas-api-revoke-sub-6a49ea64-cmt6t Container created 53m Normal Started pod/maas-api-revoke-sub-6a49ea64-cmt6t Container started 53m Normal AddedInterface pod/maas-api-revoke-sub-7e81b3e0-m65cg Add eth0 [10.133.0.83/23] from ovn-kubernetes 53m Normal Pulled pod/maas-api-revoke-sub-7e81b3e0-m65cg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Completed job/maas-api-revoke-sub-9d1e101f Job completed 53m Normal Created pod/maas-api-revoke-sub-7e81b3e0-m65cg Container created 53m Normal Started pod/maas-api-revoke-sub-7e81b3e0-m65cg Container started 53m Normal Completed job/maas-api-revoke-sub-6a49ea64 Job completed 53m Normal Completed job/maas-api-revoke-sub-7e81b3e0 Job completed 53m Normal Pulled pod/maas-api-revoke-sub-3021f688-c24k7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal AddedInterface pod/maas-api-revoke-sub-3021f688-c24k7 Add eth0 [10.133.0.84/23] from ovn-kubernetes 53m Normal SuccessfulCreate job/maas-api-revoke-sub-3021f688 Created pod: maas-api-revoke-sub-3021f688-c24k7 53m Normal Started pod/maas-api-revoke-sub-3021f688-c24k7 Container started 53m Normal Created pod/maas-api-revoke-sub-3021f688-c24k7 Container created 53m Normal Completed job/maas-api-revoke-sub-3021f688 Job completed 52m Normal SuccessfulCreate job/maas-api-revoke-sub-71ab8229 Created pod: maas-api-revoke-sub-71ab8229-n277g 52m Normal Created pod/maas-api-revoke-sub-71ab8229-n277g Container created 52m Normal AddedInterface pod/maas-api-revoke-sub-71ab8229-n277g Add eth0 [10.133.0.90/23] from ovn-kubernetes 52m Normal Started pod/maas-api-revoke-sub-71ab8229-n277g Container started 52m Normal Pulled pod/maas-api-revoke-sub-71ab8229-n277g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal SuccessfulCreate job/maas-api-revoke-sub-2bea5546 Created pod: maas-api-revoke-sub-2bea5546-69mm8 52m Normal SuccessfulCreate job/maas-api-revoke-sub-202061a5 Created pod: maas-api-revoke-sub-202061a5-q5mr5 52m Normal AddedInterface pod/maas-api-revoke-sub-202061a5-q5mr5 Add eth0 [10.133.0.91/23] from ovn-kubernetes 52m Normal Created pod/maas-api-revoke-sub-2bea5546-69mm8 Container created 52m Normal Completed job/maas-api-revoke-sub-71ab8229 Job completed 52m Normal Started pod/maas-api-revoke-sub-202061a5-q5mr5 Container started 52m Normal Created pod/maas-api-revoke-sub-202061a5-q5mr5 Container created 52m Normal AddedInterface pod/maas-api-revoke-sub-2bea5546-69mm8 Add eth0 [10.133.0.92/23] from ovn-kubernetes 52m Normal Pulled pod/maas-api-revoke-sub-202061a5-q5mr5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal SuccessfulCreate job/maas-api-revoke-sub-60c04f47 Created pod: maas-api-revoke-sub-60c04f47-phxjt 52m Normal Started pod/maas-api-revoke-sub-2bea5546-69mm8 Container started 52m Normal Pulled pod/maas-api-revoke-sub-2bea5546-69mm8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Pulled pod/maas-api-revoke-sub-60c04f47-phxjt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Created pod/maas-api-revoke-sub-60c04f47-phxjt Container created 52m Normal Started pod/maas-api-revoke-sub-60c04f47-phxjt Container started 52m Normal AddedInterface pod/maas-api-revoke-sub-60c04f47-phxjt Add eth0 [10.133.0.93/23] from ovn-kubernetes 52m Normal Completed job/maas-api-revoke-sub-202061a5 Job completed 52m Normal Completed job/maas-api-revoke-sub-2bea5546 Job completed 52m Normal Completed job/maas-api-revoke-sub-60c04f47 Job completed 52m Normal SuccessfulCreate job/maas-api-revoke-sub-c1ce8661 Created pod: maas-api-revoke-sub-c1ce8661-896xd 52m Normal Pulled pod/maas-api-revoke-sub-c1ce8661-896xd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal SuccessfulCreate job/maas-api-revoke-sub-88c73b74 Created pod: maas-api-revoke-sub-88c73b74-f8d7p 52m Normal AddedInterface pod/maas-api-revoke-sub-c1ce8661-896xd Add eth0 [10.133.0.95/23] from ovn-kubernetes 52m Normal Created pod/maas-api-revoke-sub-88c73b74-f8d7p Container created 52m Normal Started pod/maas-api-revoke-sub-88c73b74-f8d7p Container started 52m Normal Started pod/maas-api-revoke-sub-c1ce8661-896xd Container started 52m Normal Created pod/maas-api-revoke-sub-c1ce8661-896xd Container created 52m Normal AddedInterface pod/maas-api-revoke-sub-88c73b74-f8d7p Add eth0 [10.133.0.96/23] from ovn-kubernetes 52m Normal Pulled pod/maas-api-revoke-sub-88c73b74-f8d7p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal SuccessfulCreate job/maas-api-revoke-sub-43f71aef Created pod: maas-api-revoke-sub-43f71aef-n4w8d 52m Normal Started pod/maas-api-revoke-sub-43f71aef-n4w8d Container started 52m Normal Created pod/maas-api-revoke-sub-43f71aef-n4w8d Container created 52m Normal Pulled pod/maas-api-revoke-sub-43f71aef-n4w8d Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-api-revoke-sub-43f71aef-n4w8d Add eth0 [10.133.0.97/23] from ovn-kubernetes 52m Normal Completed job/maas-api-revoke-sub-88c73b74 Job completed 52m Normal Completed job/maas-api-revoke-sub-c1ce8661 Job completed 52m Normal Completed job/maas-api-revoke-sub-43f71aef Job completed 52m Normal SuccessfulCreate job/maas-api-revoke-sub-168ced75 Created pod: maas-api-revoke-sub-168ced75-rrqtz 51m Normal AddedInterface pod/maas-api-revoke-sub-168ced75-rrqtz Add eth0 [10.133.0.98/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-168ced75-rrqtz Container created 51m Normal Started pod/maas-api-revoke-sub-168ced75-rrqtz Container started 51m Normal Pulled pod/maas-api-revoke-sub-168ced75-rrqtz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Completed job/maas-api-revoke-sub-168ced75 Job completed 51m Normal Pulled pod/maas-api-revoke-sub-eef45f53-984js Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-eef45f53-984js Add eth0 [10.133.0.99/23] from ovn-kubernetes 51m Normal SuccessfulCreate job/maas-api-revoke-sub-eef45f53 Created pod: maas-api-revoke-sub-eef45f53-984js 51m Normal Created pod/maas-api-revoke-sub-eef45f53-984js Container created 51m Normal Started pod/maas-api-revoke-sub-eef45f53-984js Container started 51m Normal Completed job/maas-api-revoke-sub-eef45f53 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-d3872f64 Created pod: maas-api-revoke-sub-d3872f64-wjb5s 51m Normal Pulled pod/maas-api-revoke-sub-d3872f64-wjb5s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-d3872f64-wjb5s Add eth0 [10.133.0.104/23] from ovn-kubernetes 51m Normal Started pod/maas-api-revoke-sub-d3872f64-wjb5s Container started 51m Normal Created pod/maas-api-revoke-sub-d3872f64-wjb5s Container created 51m Normal SuccessfulCreate job/maas-api-revoke-sub-c69d5760 Created pod: maas-api-revoke-sub-c69d5760-jkfcx 51m Normal Pulled pod/maas-api-revoke-sub-c69d5760-jkfcx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal SuccessfulCreate job/maas-api-revoke-sub-05036bc6 Created pod: maas-api-revoke-sub-05036bc6-gv94s 51m Normal Started pod/maas-api-revoke-sub-c69d5760-jkfcx Container started 51m Normal Created pod/maas-api-revoke-sub-c69d5760-jkfcx Container created 51m Normal AddedInterface pod/maas-api-revoke-sub-c69d5760-jkfcx Add eth0 [10.133.0.105/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-05036bc6-gv94s Container created 51m Normal Pulled pod/maas-api-revoke-sub-05036bc6-gv94s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Started pod/maas-api-revoke-sub-05036bc6-gv94s Container started 51m Normal AddedInterface pod/maas-api-revoke-sub-05036bc6-gv94s Add eth0 [10.133.0.106/23] from ovn-kubernetes 51m Normal Completed job/maas-api-revoke-sub-d3872f64 Job completed 51m Normal Completed job/maas-api-revoke-sub-c69d5760 Job completed 51m Normal Completed job/maas-api-revoke-sub-05036bc6 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-022c89b8 Created pod: maas-api-revoke-sub-022c89b8-dn9jf 51m Normal Created pod/maas-api-revoke-sub-022c89b8-dn9jf Container created 51m Normal Started pod/maas-api-revoke-sub-022c89b8-dn9jf Container started 51m Normal AddedInterface pod/maas-api-revoke-sub-022c89b8-dn9jf Add eth0 [10.133.0.110/23] from ovn-kubernetes 51m Normal Pulled pod/maas-api-revoke-sub-022c89b8-dn9jf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal SuccessfulCreate job/maas-api-revoke-sub-763e519d Created pod: maas-api-revoke-sub-763e519d-dmntp 51m Normal Started pod/maas-api-revoke-sub-763e519d-dmntp Container started 51m Normal Created pod/maas-api-revoke-sub-763e519d-dmntp Container created 51m Normal Pulled pod/maas-api-revoke-sub-763e519d-dmntp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-763e519d-dmntp Add eth0 [10.133.0.111/23] from ovn-kubernetes 51m Normal Completed job/maas-api-revoke-sub-022c89b8 Job completed 51m Normal Completed job/maas-api-revoke-sub-763e519d Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-2b915f7f Created pod: maas-api-revoke-sub-2b915f7f-vnj54 51m Normal Started pod/maas-api-revoke-sub-2b915f7f-vnj54 Container started 51m Normal Created pod/maas-api-revoke-sub-2b915f7f-vnj54 Container created 51m Normal Pulled pod/maas-api-revoke-sub-2b915f7f-vnj54 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-2b915f7f-vnj54 Add eth0 [10.133.0.112/23] from ovn-kubernetes 51m Normal AddedInterface pod/maas-api-revoke-sub-1b14588b-f69sl Add eth0 [10.133.0.113/23] from ovn-kubernetes 51m Normal Pulled pod/maas-api-revoke-sub-1b14588b-f69sl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal SuccessfulCreate job/maas-api-revoke-sub-1b14588b Created pod: maas-api-revoke-sub-1b14588b-f69sl 51m Normal Created pod/maas-api-revoke-sub-1b14588b-f69sl Container created 51m Normal Started pod/maas-api-revoke-sub-1b14588b-f69sl Container started 51m Normal Completed job/maas-api-revoke-sub-2b915f7f Job completed 51m Normal Completed job/maas-api-revoke-sub-1b14588b Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-9b23add5 Created pod: maas-api-revoke-sub-9b23add5-ms2rj 51m Normal AddedInterface pod/maas-api-revoke-sub-9b23add5-ms2rj Add eth0 [10.133.0.114/23] from ovn-kubernetes 51m Normal Started pod/maas-api-revoke-sub-9b23add5-ms2rj Container started 51m Normal Pulled pod/maas-api-revoke-sub-9b23add5-ms2rj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Created pod/maas-api-revoke-sub-9b23add5-ms2rj Container created 51m Normal AddedInterface pod/maas-api-revoke-sub-d3805d87-9vc66 Add eth0 [10.133.0.115/23] from ovn-kubernetes 51m Normal Pulled pod/maas-api-revoke-sub-d3805d87-9vc66 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal SuccessfulCreate job/maas-api-revoke-sub-d3805d87 Created pod: maas-api-revoke-sub-d3805d87-9vc66 51m Normal Created pod/maas-api-revoke-sub-d3805d87-9vc66 Container created 51m Normal Started pod/maas-api-revoke-sub-d3805d87-9vc66 Container started 51m Normal Pulled pod/maas-api-revoke-sub-4d689555-rtgqn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-4d689555-rtgqn Add eth0 [10.133.0.117/23] from ovn-kubernetes 51m Normal Completed job/maas-api-revoke-sub-9b23add5 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-4d689555 Created pod: maas-api-revoke-sub-4d689555-rtgqn 51m Normal Completed job/maas-api-revoke-sub-d3805d87 Job completed 51m Normal Created pod/maas-api-revoke-sub-4d689555-rtgqn Container created 51m Normal Started pod/maas-api-revoke-sub-4d689555-rtgqn Container started 51m Normal Completed job/maas-api-revoke-sub-4d689555 Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-6be5590e-kkcjf Add eth0 [10.133.0.118/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-6be5590e Created pod: maas-api-revoke-sub-6be5590e-kkcjf 50m Normal Pulled pod/maas-api-revoke-sub-6be5590e-kkcjf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal SuccessfulCreate job/maas-api-revoke-sub-133fe481 Created pod: maas-api-revoke-sub-133fe481-sktzm 50m Normal Pulled pod/maas-api-revoke-sub-133fe481-sktzm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-133fe481-sktzm Container created 50m Normal Started pod/maas-api-revoke-sub-133fe481-sktzm Container started 50m Normal Created pod/maas-api-revoke-sub-6be5590e-kkcjf Container created 50m Normal Started pod/maas-api-revoke-sub-6be5590e-kkcjf Container started 50m Normal AddedInterface pod/maas-api-revoke-sub-133fe481-sktzm Add eth0 [10.133.0.119/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-e8c9dbc3 Created pod: maas-api-revoke-sub-e8c9dbc3-s46qd 50m Normal Created pod/maas-api-revoke-sub-e8c9dbc3-s46qd Container created 50m Normal Pulled pod/maas-api-revoke-sub-e8c9dbc3-s46qd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-e8c9dbc3-s46qd Add eth0 [10.133.0.120/23] from ovn-kubernetes 50m Normal Completed job/maas-api-revoke-sub-6be5590e Job completed 50m Normal Started pod/maas-api-revoke-sub-e8c9dbc3-s46qd Container started 50m Normal Completed job/maas-api-revoke-sub-133fe481 Job completed 50m Normal Completed job/maas-api-revoke-sub-e8c9dbc3 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-5f50b80f Created pod: maas-api-revoke-sub-5f50b80f-fsf5t 50m Normal SuccessfulCreate job/maas-api-revoke-sub-b395cac9 Created pod: maas-api-revoke-sub-b395cac9-d6qpk 50m Normal AddedInterface pod/maas-api-revoke-sub-b395cac9-d6qpk Add eth0 [10.133.0.127/23] from ovn-kubernetes 50m Normal AddedInterface pod/maas-api-revoke-sub-5f50b80f-fsf5t Add eth0 [10.133.0.125/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-5f50b80f-fsf5t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal SuccessfulCreate job/maas-api-revoke-sub-d0aae7c2 Created pod: maas-api-revoke-sub-d0aae7c2-2jh7z 50m Normal Pulled pod/maas-api-revoke-sub-d0aae7c2-2jh7z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Pulled pod/maas-api-revoke-sub-b395cac9-d6qpk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-d0aae7c2-2jh7z Add eth0 [10.133.0.128/23] from ovn-kubernetes 50m Normal Created pod/maas-api-revoke-sub-5f50b80f-fsf5t Container created 50m Normal Started pod/maas-api-revoke-sub-b395cac9-d6qpk Container started 50m Normal Started pod/maas-api-revoke-sub-5f50b80f-fsf5t Container started 50m Normal Created pod/maas-api-revoke-sub-b395cac9-d6qpk Container created 50m Normal Created pod/maas-api-revoke-sub-d0aae7c2-2jh7z Container created 50m Normal Started pod/maas-api-revoke-sub-d0aae7c2-2jh7z Container started 50m Normal Completed job/maas-api-revoke-sub-5f50b80f Job completed 50m Normal Completed job/maas-api-revoke-sub-b395cac9 Job completed 50m Normal Completed job/maas-api-revoke-sub-d0aae7c2 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-466e6410 Created pod: maas-api-revoke-sub-466e6410-lgf5v 50m Normal AddedInterface pod/maas-api-revoke-sub-466e6410-lgf5v Add eth0 [10.133.0.129/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-466e6410-lgf5v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-466e6410-lgf5v Container created 50m Normal Started pod/maas-api-revoke-sub-466e6410-lgf5v Container started 50m Normal SuccessfulCreate job/maas-api-revoke-sub-58c83b18 Created pod: maas-api-revoke-sub-58c83b18-dn8qc 50m Normal AddedInterface pod/maas-api-revoke-sub-58c83b18-dn8qc Add eth0 [10.133.0.130/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-58c83b18-dn8qc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-58c83b18-dn8qc Container created 50m Normal SuccessfulCreate job/maas-api-revoke-sub-461da871 Created pod: maas-api-revoke-sub-461da871-67j5m 50m Normal Started pod/maas-api-revoke-sub-58c83b18-dn8qc Container started 50m Normal AddedInterface pod/maas-api-revoke-sub-461da871-67j5m Add eth0 [10.133.0.131/23] from ovn-kubernetes 50m Normal Completed job/maas-api-revoke-sub-466e6410 Job completed 50m Normal Pulled pod/maas-api-revoke-sub-461da871-67j5m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-461da871-67j5m Container created 50m Normal Started pod/maas-api-revoke-sub-461da871-67j5m Container started 50m Normal Completed job/maas-api-revoke-sub-58c83b18 Job completed 50m Normal Completed job/maas-api-revoke-sub-461da871 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-8df2ee44 Created pod: maas-api-revoke-sub-8df2ee44-54j84 50m Normal Pulled pod/maas-api-revoke-sub-8df2ee44-54j84 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal SuccessfulCreate job/maas-api-revoke-sub-28004554 Created pod: maas-api-revoke-sub-28004554-hf7p5 50m Normal AddedInterface pod/maas-api-revoke-sub-8df2ee44-54j84 Add eth0 [10.133.0.133/23] from ovn-kubernetes 50m Normal Started pod/maas-api-revoke-sub-28004554-hf7p5 Container started 50m Normal Created pod/maas-api-revoke-sub-28004554-hf7p5 Container created 50m Normal Pulled pod/maas-api-revoke-sub-28004554-hf7p5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-8df2ee44-54j84 Container created 50m Normal Started pod/maas-api-revoke-sub-8df2ee44-54j84 Container started 50m Normal AddedInterface pod/maas-api-revoke-sub-28004554-hf7p5 Add eth0 [10.133.0.134/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-3c8a7907 Created pod: maas-api-revoke-sub-3c8a7907-j5pm2 50m Normal AddedInterface pod/maas-api-revoke-sub-3c8a7907-j5pm2 Add eth0 [10.133.0.135/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-3c8a7907-j5pm2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-3c8a7907-j5pm2 Container created 50m Normal Started pod/maas-api-revoke-sub-3c8a7907-j5pm2 Container started 50m Normal Completed job/maas-api-revoke-sub-8df2ee44 Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-d3917d7c-25tgd Add eth0 [10.133.0.136/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-d3917d7c-25tgd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Completed job/maas-api-revoke-sub-28004554 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-d3917d7c Created pod: maas-api-revoke-sub-d3917d7c-25tgd 50m Normal Created pod/maas-api-revoke-sub-d3917d7c-25tgd Container created 50m Normal Started pod/maas-api-revoke-sub-d3917d7c-25tgd Container started 50m Normal Completed job/maas-api-revoke-sub-3c8a7907 Job completed 50m Normal Completed job/maas-api-revoke-sub-d3917d7c Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-c3de0bdc Created pod: maas-api-revoke-sub-c3de0bdc-hwfw4 50m Normal SuccessfulCreate job/maas-api-revoke-sub-40a76272 Created pod: maas-api-revoke-sub-40a76272-5k7p6 50m Normal SuccessfulCreate job/maas-api-revoke-sub-343574e2 Created pod: maas-api-revoke-sub-343574e2-zk87f 50m Normal Pulled pod/maas-api-revoke-sub-343574e2-zk87f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Pulled pod/maas-api-revoke-sub-40a76272-5k7p6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-40a76272-5k7p6 Add eth0 [10.133.0.138/23] from ovn-kubernetes 50m Normal AddedInterface pod/maas-api-revoke-sub-343574e2-zk87f Add eth0 [10.133.0.137/23] from ovn-kubernetes 49m Normal Started pod/maas-api-revoke-sub-343574e2-zk87f Container started 49m Normal Created pod/maas-api-revoke-sub-343574e2-zk87f Container created 49m Normal Started pod/maas-api-revoke-sub-40a76272-5k7p6 Container started 49m Normal Created pod/maas-api-revoke-sub-40a76272-5k7p6 Container created 49m Normal SuccessfulCreate job/maas-api-revoke-sub-0690fdaf Created pod: maas-api-revoke-sub-0690fdaf-kg8xn 49m Normal AddedInterface pod/maas-api-revoke-sub-c3de0bdc-hwfw4 Add eth0 [10.133.0.139/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-revoke-sub-c3de0bdc-hwfw4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-sub-c3de0bdc-hwfw4 Container created 49m Normal AddedInterface pod/maas-api-revoke-sub-0690fdaf-kg8xn Add eth0 [10.133.0.140/23] from ovn-kubernetes 49m Normal Started pod/maas-api-revoke-sub-c3de0bdc-hwfw4 Container started 49m Normal Pulled pod/maas-api-revoke-sub-0690fdaf-kg8xn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Completed job/maas-api-revoke-sub-40a76272 Job completed 49m Normal Started pod/maas-api-revoke-sub-0690fdaf-kg8xn Container started 49m Normal Completed job/maas-api-revoke-sub-343574e2 Job completed 49m Normal Created pod/maas-api-revoke-sub-0690fdaf-kg8xn Container created 49m Normal Completed job/maas-api-revoke-sub-c3de0bdc Job completed 49m Normal Completed job/maas-api-revoke-sub-0690fdaf Job completed 49m Normal SuccessfulCreate job/maas-api-revoke-sub-e66adadd Created pod: maas-api-revoke-sub-e66adadd-ql562 49m Normal AddedInterface pod/maas-api-revoke-sub-e66adadd-ql562 Add eth0 [10.133.0.147/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-revoke-sub-e66adadd-ql562 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-sub-e66adadd-ql562 Container created 49m Normal Started pod/maas-api-revoke-sub-e66adadd-ql562 Container started 49m Normal SuccessfulCreate job/maas-api-revoke-sub-325a4b2e Created pod: maas-api-revoke-sub-325a4b2e-q7jng 49m Normal AddedInterface pod/maas-api-revoke-sub-325a4b2e-q7jng Add eth0 [10.133.0.148/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-revoke-sub-325a4b2e-q7jng Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-sub-325a4b2e-q7jng Container created 49m Normal Completed job/maas-api-revoke-sub-e66adadd Job completed 49m Normal Started pod/maas-api-revoke-sub-325a4b2e-q7jng Container started 49m Normal Completed job/maas-api-revoke-sub-325a4b2e Job completed 49m Normal SuccessfulCreate replicaset/maas-api-e2e-migrate-54d4943b-5774996df6 Created pod: maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr 49m Normal ScalingReplicaSet deployment/maas-api-e2e-migrate-54d4943b Scaled up replica set maas-api-e2e-migrate-54d4943b-5774996df6 from 0 to 1 49m Normal AddedInterface pod/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr Add eth0 [10.134.0.74/23] from ovn-kubernetes 49m Normal Pulling pod/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 49m Normal SuccessfulCreate job/maas-api-revoke-sub-e4325a71 Created pod: maas-api-revoke-sub-e4325a71-9tzsn 49m Normal Created pod/maas-api-revoke-sub-e4325a71-9tzsn Container created 49m Normal Pulled pod/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 393ms (393ms including waiting). Image size: 194510193 bytes. 49m Normal Pulled pod/maas-api-revoke-sub-e4325a71-9tzsn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal AddedInterface pod/maas-api-revoke-sub-e4325a71-9tzsn Add eth0 [10.133.0.150/23] from ovn-kubernetes 49m Normal Created pod/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr Container created 49m Normal Started pod/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr Container started 49m Normal Started pod/maas-api-revoke-sub-e4325a71-9tzsn Container started 49m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-709c4831 Scaled up replica set maas-api-e2e-ait-709c4831-57686c497f from 0 to 1 49m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-709c4831-57686c497f Created pod: maas-api-e2e-ait-709c4831-57686c497f-nkbfw 49m Warning FailedMount pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-709c4831-serving-cert" not found 49m Normal Completed job/maas-api-revoke-sub-e4325a71 Job completed 49m Normal AddedInterface pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw Add eth0 [10.132.0.98/23] from ovn-kubernetes 49m Normal Pulling pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 49m Normal Pulled pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 728ms (728ms including waiting). Image size: 194510193 bytes. 49m Normal Created pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw Container created 49m Normal Started pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw Container started 49m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-migrate-54d4943b Created pod: maas-api-revoke-keys-e2e-migrate-54d4943b-kkzrq 49m Normal Pulled pod/maas-api-revoke-keys-e2e-migrate-54d4943b-kkzrq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-keys-e2e-migrate-54d4943b-kkzrq Container created 49m Normal AddedInterface pod/maas-api-revoke-keys-e2e-migrate-54d4943b-kkzrq Add eth0 [10.133.0.153/23] from ovn-kubernetes 49m Normal Started pod/maas-api-revoke-keys-e2e-migrate-54d4943b-kkzrq Container started 49m Normal Completed job/maas-api-revoke-keys-e2e-migrate-54d4943b Job completed 49m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-709c4831 Created pod: maas-api-revoke-keys-e2e-ait-709c4831-4qwgl 49m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-709c4831-4qwgl Add eth0 [10.133.0.154/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-709c4831-4qwgl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-keys-e2e-ait-709c4831-4qwgl Container created 49m Normal Started pod/maas-api-revoke-keys-e2e-ait-709c4831-4qwgl Container started 48m Normal Completed job/maas-api-revoke-keys-e2e-ait-709c4831 Job completed 48m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9 Created pod: maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 48m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w3-6b5b1e Scaled up replica set maas-api-e2e-shared-a-w3-6b5b1e-5546447df9 from 0 to 1 48m Normal AddedInterface pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Add eth0 [10.134.0.76/23] from ovn-kubernetes 48m Normal Pulled pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 388ms (388ms including waiting). Image size: 194510193 bytes. 48m Normal Pulling pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal Killing pod/maas-api-e2e-migrate-54d4943b-5774996df6-zwkbr Stopping container maas-api 48m Normal Started pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Container started 48m Normal Created pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Container created 48m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ait-709c4831 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ait-709c4831: Operation cannot be fulfilled on endpoints "maas-api-e2e-ait-709c4831": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ait-709c4831, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d52bebd9-0338-433a-991f-2cb906c79b61, UID in object meta: 48m Normal Killing pod/maas-api-e2e-ait-709c4831-57686c497f-nkbfw Stopping container maas-api 48m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-a095fc35-746c6b9744 Created pod: maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 48m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-a095fc35 Scaled up replica set maas-api-e2e-ait-a095fc35-746c6b9744 from 0 to 1 48m Normal Pulled pod/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 336ms (336ms including waiting). Image size: 194510193 bytes. 48m Normal Created pod/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 Container created 48m Normal Started pod/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 Container started 48m Normal AddedInterface pod/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 Add eth0 [10.134.0.79/23] from ovn-kubernetes 48m Normal Pulling pod/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal AddedInterface pod/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 Add eth0 [10.134.0.80/23] from ovn-kubernetes 48m Normal SuccessfulCreate replicaset/maas-api-e2e-derive-e2a1565f-694dd5c9fd Created pod: maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 48m Normal Pulling pod/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal ScalingReplicaSet deployment/maas-api-e2e-derive-e2a1565f Scaled up replica set maas-api-e2e-derive-e2a1565f-694dd5c9fd from 0 to 1 48m Normal Started pod/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 Container started 48m Normal Created pod/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 Container created 48m Normal Pulled pod/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 652ms (652ms including waiting). Image size: 194510193 bytes. 48m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w3-c73fcb-885c74b49 Created pod: maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q 48m Warning FailedMount pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-b-w3-c73fcb-serving-cert" not found 48m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w3-c73fcb Scaled up replica set maas-api-e2e-shared-b-w3-c73fcb-885c74b49 from 0 to 1 48m Normal Created pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q Container created 48m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-a095fc35 Created pod: maas-api-revoke-keys-e2e-ait-a095fc35-v4vnq 48m Normal Started pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q Container started 48m Normal AddedInterface pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q Add eth0 [10.134.0.81/23] from ovn-kubernetes 48m Normal Pulling pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal Pulled pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 332ms (332ms including waiting). Image size: 194510193 bytes. 48m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-a095fc35-v4vnq Add eth0 [10.133.0.161/23] from ovn-kubernetes 48m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-a095fc35-v4vnq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-derive-e2a1565f Created pod: maas-api-revoke-keys-e2e-derive-e2a1565f-tr4qx 48m Normal Pulled pod/maas-api-revoke-keys-e2e-derive-e2a1565f-tr4qx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/maas-api-revoke-keys-e2e-derive-e2a1565f-tr4qx Add eth0 [10.133.0.162/23] from ovn-kubernetes 48m Normal Started pod/maas-api-revoke-keys-e2e-ait-a095fc35-v4vnq Container started 48m Normal Created pod/maas-api-revoke-keys-e2e-ait-a095fc35-v4vnq Container created 48m Normal Created pod/maas-api-revoke-keys-e2e-derive-e2a1565f-tr4qx Container created 48m Normal Started pod/maas-api-revoke-keys-e2e-derive-e2a1565f-tr4qx Container started 47m Normal Completed job/maas-api-revoke-keys-e2e-ait-a095fc35 Job completed 47m Normal Completed job/maas-api-revoke-keys-e2e-derive-e2a1565f Job completed 47m Normal SuccessfulCreate job/maas-api-revoke-sub-01d8a893 Created pod: maas-api-revoke-sub-01d8a893-xptcl 47m Normal Started pod/maas-api-revoke-sub-01d8a893-xptcl Container started 47m Normal Pulled pod/maas-api-revoke-sub-01d8a893-xptcl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 47m Normal Created pod/maas-api-revoke-sub-01d8a893-xptcl Container created 47m Normal AddedInterface pod/maas-api-revoke-sub-01d8a893-xptcl Add eth0 [10.133.0.164/23] from ovn-kubernetes 47m Normal Completed job/maas-api-revoke-sub-01d8a893 Job completed 47m Normal Killing pod/maas-api-e2e-ait-a095fc35-746c6b9744-8fw99 Stopping container maas-api 47m Normal Killing pod/maas-api-e2e-derive-e2a1565f-694dd5c9fd-tjhf2 Stopping container maas-api 47m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-1b2243ef-54bff4576 Created pod: maas-api-e2e-mt-1b2243ef-54bff4576-k46cx 47m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-1b2243ef Scaled up replica set maas-api-e2e-mt-1b2243ef-54bff4576 from 0 to 1 47m Normal Pulled pod/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 331ms (331ms including waiting). Image size: 194510193 bytes. 47m Normal Pulling pod/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 47m Normal AddedInterface pod/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx Add eth0 [10.132.0.101/23] from ovn-kubernetes 47m Normal Created pod/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx Container created 47m Normal Started pod/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx Container started 47m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w6-477f6b-78c65f767 Created pod: maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 47m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w6-477f6b Scaled up replica set maas-api-e2e-shared-a-w6-477f6b-78c65f767 from 0 to 1 47m Normal Pulling pod/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 47m Normal AddedInterface pod/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 Add eth0 [10.132.0.103/23] from ovn-kubernetes 47m Normal Started pod/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 Container started 47m Normal Pulled pod/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 289ms (289ms including waiting). Image size: 194510193 bytes. 47m Normal Created pod/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 Container created 47m Warning FailedMount pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-a-w4-815776-serving-cert" not found 47m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w4-815776-54cf7c64bc Created pod: maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w 47m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w4-815776 Scaled up replica set maas-api-e2e-shared-a-w4-815776-54cf7c64bc from 0 to 1 47m Normal Created pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w Container created 47m Normal Pulled pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 390ms (390ms including waiting). Image size: 194510193 bytes. 47m Normal Pulling pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 47m Normal AddedInterface pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w Add eth0 [10.134.0.90/23] from ovn-kubernetes 47m Normal Started pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w Container started 47m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-3571f8-d6b59cd5d Created pod: maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk 47m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-3571f8 Scaled up replica set maas-api-e2e-api-a-3571f8-d6b59cd5d from 0 to 1 47m Warning FailedMount pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-api-a-3571f8-serving-cert" not found 47m Normal Started pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Container started 47m Normal Pulled pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 338ms (338ms including waiting). Image size: 194510193 bytes. 47m Normal Pulling pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 47m Normal AddedInterface pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Add eth0 [10.132.0.104/23] from ovn-kubernetes 47m Normal Created pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Container created 46m Warning FailedMount pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-api-a-d4ccc5-serving-cert" not found 46m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-d4ccc5 Scaled up replica set maas-api-e2e-api-a-d4ccc5-dd9ff4874 from 0 to 1 46m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-d4ccc5-dd9ff4874 Created pod: maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv 46m Normal Pulling pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 46m Normal AddedInterface pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Add eth0 [10.132.0.105/23] from ovn-kubernetes 46m Normal Pulled pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 293ms (293ms including waiting). Image size: 194510193 bytes. 46m Normal Created pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Container created 46m Normal Started pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Container started 46m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w6-f22a52 Scaled up replica set maas-api-e2e-shared-b-w6-f22a52-7c87c958cb from 0 to 1 46m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb Created pod: maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq 46m Normal Pulling pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 46m Normal AddedInterface pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Add eth0 [10.132.0.106/23] from ovn-kubernetes 46m Normal Pulled pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 488ms (488ms including waiting). Image size: 194510193 bytes. 46m Normal Started pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Container started 46m Normal Created pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Container created 46m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df Created pod: maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm 46m Normal AddedInterface pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Add eth0 [10.132.0.108/23] from ovn-kubernetes 46m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w4-cc33d3 Scaled up replica set maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df from 0 to 1 46m Normal Pulling pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 46m Normal Started pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Container started 46m Normal Created pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Container created 46m Normal Pulled pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 390ms (390ms including waiting). Image size: 194510193 bytes. 46m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-4fc75f-5d5864445b Created pod: maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj 46m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-4fc75f Scaled up replica set maas-api-e2e-api-b-4fc75f-5d5864445b from 0 to 1 45m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-3571f8-d6b59cd5d Created pod: maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 45m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-d4ccc5-dd9ff4874 Created pod: maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf 45m Normal Killing pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-csthv Stopping container maas-api 45m Normal Killing pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-sgxrm Stopping container maas-api 45m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df Created pod: maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 45m Normal Killing pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-frdtq Stopping container maas-api 45m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb Created pod: maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt 45m Normal Killing pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-d97rk Stopping container maas-api 45m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-b202a0 Scaled up replica set maas-api-e2e-api-b-b202a0-77fdbcd45b from 0 to 1 45m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-b202a0-77fdbcd45b Created pod: maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk 45m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-1b2243ef Created pod: maas-api-revoke-keys-e2e-mt-1b2243ef-4mzdz 45m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4mzdz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4mzdz Add eth0 [10.133.0.189/23] from ovn-kubernetes 45m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-a3efab09-84b4999bbb Created pod: maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl 45m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-a3efab09 Scaled up replica set maas-api-e2e-mt-a3efab09-84b4999bbb from 0 to 1 45m Normal Created pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4mzdz Container created 45m Normal Started pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4mzdz Container started 45m Normal Completed job/maas-api-revoke-keys-e2e-mt-1b2243ef Job completed 45m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-862dc2-69c5dffb64 Created pod: maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh 45m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-862dc2 Scaled up replica set maas-api-e2e-inf-a-862dc2-69c5dffb64 from 0 to 1 44m Normal Pulling pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal AddedInterface pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl Add eth0 [10.133.0.191/23] from ovn-kubernetes 44m Normal AddedInterface pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk Add eth0 [10.133.0.192/23] from ovn-kubernetes 44m Normal Pulling pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal AddedInterface pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh Add eth0 [10.133.0.190/23] from ovn-kubernetes 44m Normal Pulling pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal AddedInterface pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Add eth0 [10.133.0.193/23] from ovn-kubernetes 44m Normal Pulling pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal SuccessfulCreate job/maas-api-revoke-sub-1135c258 Created pod: maas-api-revoke-sub-1135c258-llwn6 44m Normal AddedInterface pod/maas-api-revoke-sub-1135c258-llwn6 Add eth0 [10.133.0.195/23] from ovn-kubernetes 44m Normal Pulled pod/maas-api-revoke-sub-1135c258-llwn6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal Created pod/maas-api-revoke-sub-1135c258-llwn6 Container created 44m Normal Started pod/maas-api-revoke-sub-1135c258-llwn6 Container started 44m Normal Completed job/maas-api-revoke-sub-1135c258 Job completed 44m Normal Pulled pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 9.389s (9.389s including waiting). Image size: 194510193 bytes. 44m Normal Started pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl Container started 44m Normal Created pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl Container created 44m Normal Pulled pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 9.363s (9.363s including waiting). Image size: 194510193 bytes. 44m Normal Pulled pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 9.497s (9.497s including waiting). Image size: 194510193 bytes. 44m Normal Created pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh Container created 44m Normal Started pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh Container started 44m Normal Created pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk Container created 44m Normal Created pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Container created 44m Normal Pulled pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 9.911s (9.911s including waiting). Image size: 194510193 bytes. 44m Normal Started pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk Container started 44m Normal Started pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Container started 44m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-d4ccc5 Created pod: maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 44m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 Add eth0 [10.133.0.196/23] from ovn-kubernetes 44m Normal Killing pod/maas-api-e2e-mt-1b2243ef-54bff4576-k46cx Stopping container maas-api 44m Normal AddedInterface pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt Add eth0 [10.132.0.110/23] from ovn-kubernetes 44m Normal Pulling pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal AddedInterface pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 Add eth0 [10.133.0.198/23] from ovn-kubernetes 44m Normal Pulled pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 430ms (430ms including waiting). Image size: 194510193 bytes. 44m Normal Pulling pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal Started pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt Container started 44m Normal Pulling pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal Created pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt Container created 44m Normal Pulling pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal AddedInterface pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 Add eth0 [10.133.0.199/23] from ovn-kubernetes 44m Normal AddedInterface pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf Add eth0 [10.133.0.200/23] from ovn-kubernetes 44m Normal Pulled pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 357ms (357ms including waiting). Image size: 194510193 bytes. 44m Normal Started pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 Container started 44m Normal Pulled pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 348ms (348ms including waiting). Image size: 194510193 bytes. 44m Normal Created pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf Container created 44m Normal Created pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 Container created 44m Normal Pulled pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 347ms (347ms including waiting). Image size: 194510193 bytes. 44m Normal Created pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 Container created 44m Normal Started pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 Container started 44m Normal Started pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf Container started 44m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal Created pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 Container created 44m Normal Started pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 Container started 44m Warning BackOff pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 Back-off restarting failed container revoke-keys in pod maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5_odh-ai-gateway-infra(a8347028-f288-4b54-9174-d30374825a2f) 44m Normal SuccessfulDelete job/maas-api-revoke-keys-e2e-api-a-d4ccc5 Deleted pod: maas-api-revoke-keys-e2e-api-a-d4ccc5-vj4g5 44m Warning BackoffLimitExceeded job/maas-api-revoke-keys-e2e-api-a-d4ccc5 Job has reached the specified backoff limit 44m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-d4ccc5 Created pod: maas-api-revoke-keys-e2e-api-a-d4ccc5-9hf2b 44m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-3571f8 Created pod: maas-api-revoke-keys-e2e-api-a-3571f8-q526k 44m Normal Pulling pod/maas-api-revoke-keys-e2e-api-a-3571f8-q526k Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 44m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-3571f8-q526k Add eth0 [10.132.0.111/23] from ovn-kubernetes 43m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-9hf2b Add eth0 [10.133.0.205/23] from ovn-kubernetes 43m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-9hf2b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 43m Normal Created pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-9hf2b Container created 43m Normal Started pod/maas-api-revoke-keys-e2e-api-a-d4ccc5-9hf2b Container started 43m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-3571f8-q526k Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.332s (2.332s including waiting). Image size: 107195206 bytes. 43m Normal Created pod/maas-api-revoke-keys-e2e-api-a-3571f8-q526k Container created 43m Normal Started pod/maas-api-revoke-keys-e2e-api-a-3571f8-q526k Container started 43m Normal Completed job/maas-api-revoke-keys-e2e-api-a-d4ccc5 Job completed 43m Normal Completed job/maas-api-revoke-keys-e2e-api-a-3571f8 Job completed 43m Normal AddedInterface pod/maas-api-revoke-sub-c06f23b7-sgwb5 Add eth0 [10.132.0.112/23] from ovn-kubernetes 43m Normal SuccessfulCreate job/maas-api-revoke-sub-c06f23b7 Created pod: maas-api-revoke-sub-c06f23b7-sgwb5 43m Normal Pulled pod/maas-api-revoke-sub-c06f23b7-sgwb5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 43m Normal Started pod/maas-api-revoke-sub-c06f23b7-sgwb5 Container started 43m Normal Created pod/maas-api-revoke-sub-c06f23b7-sgwb5 Container created 43m Normal Completed job/maas-api-revoke-sub-c06f23b7 Job completed 43m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-1b2243ef-54bff4576 Created pod: maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 43m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-1b2243ef Scaled up replica set maas-api-e2e-mt-1b2243ef-54bff4576 from 0 to 1 43m Normal Pulled pod/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 462ms (462ms including waiting). Image size: 194510193 bytes. 43m Normal AddedInterface pod/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 Add eth0 [10.133.0.206/23] from ovn-kubernetes 43m Normal Pulling pod/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 43m Normal Started pod/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 Container started 43m Normal Created pod/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 Container created 43m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-de7242-6c494cd77d Created pod: maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp 43m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-de7242 Scaled up replica set maas-api-e2e-inf-b-de7242-6c494cd77d from 0 to 1 43m Normal Pulled pod/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 444ms (444ms including waiting). Image size: 194510193 bytes. 43m Normal Pulling pod/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 43m Normal AddedInterface pod/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp Add eth0 [10.133.0.207/23] from ovn-kubernetes 43m Normal Started pod/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp Container started 43m Normal Created pod/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp Container created 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-1b2243ef Created pod: maas-api-revoke-keys-e2e-mt-1b2243ef-4jwf7 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-a3efab09 Created pod: maas-api-revoke-keys-e2e-mt-a3efab09-xmw9z 42m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-a3efab09-xmw9z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4jwf7 Add eth0 [10.132.0.113/23] from ovn-kubernetes 42m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4jwf7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-a3efab09-xmw9z Add eth0 [10.132.0.114/23] from ovn-kubernetes 42m Normal Created pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4jwf7 Container created 42m Normal Started pod/maas-api-revoke-keys-e2e-mt-a3efab09-xmw9z Container started 42m Normal Started pod/maas-api-revoke-keys-e2e-mt-1b2243ef-4jwf7 Container started 42m Normal Created pod/maas-api-revoke-keys-e2e-mt-a3efab09-xmw9z Container created 42m Normal Completed job/maas-api-revoke-keys-e2e-mt-1b2243ef Job completed 42m Normal Completed job/maas-api-revoke-keys-e2e-mt-a3efab09 Job completed 42m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-api-a-d4ccc5 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-api-a-d4ccc5: Operation cannot be fulfilled on endpoints "maas-api-e2e-api-a-d4ccc5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-api-a-d4ccc5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 73b552fc-1a9e-443f-b7cb-62c9c0b2a4b9, UID in object meta: 42m Normal Killing pod/maas-api-e2e-api-a-d4ccc5-dd9ff4874-vdtpf Stopping container maas-api 42m Normal Killing pod/maas-api-e2e-api-a-3571f8-d6b59cd5d-tlf74 Stopping container maas-api 42m Normal Killing pod/maas-api-e2e-mt-a3efab09-84b4999bbb-qjfrl Stopping container maas-api 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-b202a0 Created pod: maas-api-revoke-keys-e2e-api-b-b202a0-gpsrs 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-b202a0-gpsrs Add eth0 [10.132.0.115/23] from ovn-kubernetes 42m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-b202a0-gpsrs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal Created pod/maas-api-revoke-keys-e2e-api-b-b202a0-gpsrs Container created 42m Normal Started pod/maas-api-revoke-keys-e2e-api-b-b202a0-gpsrs Container started 42m Normal Completed job/maas-api-revoke-keys-e2e-api-b-b202a0 Job completed 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-4fc75f Created pod: maas-api-revoke-keys-e2e-api-b-4fc75f-s4pg5 42m Normal Started pod/maas-api-revoke-keys-e2e-api-b-4fc75f-s4pg5 Container started 42m Normal Created pod/maas-api-revoke-keys-e2e-api-b-4fc75f-s4pg5 Container created 42m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-4fc75f-s4pg5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-4fc75f-s4pg5 Add eth0 [10.132.0.116/23] from ovn-kubernetes 42m Normal Killing pod/maas-api-e2e-mt-1b2243ef-54bff4576-f6bz2 Stopping container maas-api 42m Normal Completed job/maas-api-revoke-keys-e2e-api-b-4fc75f Job completed 42m Normal AddedInterface pod/maas-api-revoke-sub-db02f378-2kmsp Add eth0 [10.133.0.214/23] from ovn-kubernetes 42m Normal Pulled pod/maas-api-revoke-sub-db02f378-2kmsp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal SuccessfulCreate job/maas-api-revoke-sub-db02f378 Created pod: maas-api-revoke-sub-db02f378-2kmsp 42m Normal Created pod/maas-api-revoke-sub-db02f378-2kmsp Container created 42m Normal Started pod/maas-api-revoke-sub-db02f378-2kmsp Container started 42m Normal Completed job/maas-api-revoke-sub-db02f378 Job completed 41m Normal Pulling pod/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 41m Normal AddedInterface pod/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 Add eth0 [10.133.0.215/23] from ovn-kubernetes 41m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-84dc9d-7cf58856b8 Created pod: maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 41m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-84dc9d Scaled up replica set maas-api-e2e-api-a-84dc9d-7cf58856b8 from 0 to 1 41m Normal Pulled pod/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 297ms (297ms including waiting). Image size: 194510193 bytes. 41m Normal Started pod/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 Container started 41m Normal Created pod/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 Container created 41m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-api-b-b202a0 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-api-b-b202a0: Operation cannot be fulfilled on endpoints "maas-api-e2e-api-b-b202a0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-api-b-b202a0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 36debc16-a2c8-4085-9eda-332880fb3688, UID in object meta: 41m Normal Killing pod/maas-api-e2e-api-b-b202a0-77fdbcd45b-mpfxk Stopping container maas-api 41m Normal AddedInterface pod/maas-api-revoke-sub-ae0f0b17-pntds Add eth0 [10.133.0.217/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-revoke-sub-ae0f0b17-pntds Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal SuccessfulCreate job/maas-api-revoke-sub-ae0f0b17 Created pod: maas-api-revoke-sub-ae0f0b17-pntds 41m Normal Created pod/maas-api-revoke-sub-ae0f0b17-pntds Container created 41m Normal Started pod/maas-api-revoke-sub-ae0f0b17-pntds Container started 41m Normal Completed job/maas-api-revoke-sub-ae0f0b17 Job completed 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-1354a5 Created job maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000 41m Normal Pulling pod/maas-api-key-cleanup-29889000-lkffl Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd Add eth0 [10.132.0.119/23] from ovn-kubernetes 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-4a68a1 Created job maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 Add eth0 [10.132.0.118/23] from ovn-kubernetes 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000 Created pod: maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e Created job maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb Created job maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw Add eth0 [10.132.0.122/23] from ovn-kubernetes 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t Add eth0 [10.133.0.220/23] from ovn-kubernetes 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000 Created pod: maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000 Created pod: maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-inf-a-862dc2 Created job maas-api-key-cleanup-e2e-inf-a-862dc2-29889000 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000 Created pod: maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000 Created pod: maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm 41m Normal SuccessfulCreate job/maas-api-key-cleanup-29889000 Created pod: maas-api-key-cleanup-29889000-lkffl 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w6-f22a52 Created job maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-e2e3d0 Created job maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Add eth0 [10.134.0.103/23] from ovn-kubernetes 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 Add eth0 [10.132.0.117/23] from ovn-kubernetes 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000 Created pod: maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3 Created job maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w6-477f6b Created job maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000 Created pod: maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-197e9b Created job maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-c78066 Created job maas-api-key-cleanup-e2e-worker-w2-c78066-29889000 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll Add eth0 [10.132.0.120/23] from ovn-kubernetes 41m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-a-84dc9d Created job maas-api-key-cleanup-e2e-api-a-84dc9d-29889000 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29889000 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000 Created pod: maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000 Created pod: maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000 Created pod: maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w4-815776 Created job maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch Add eth0 [10.133.0.222/23] from ovn-kubernetes 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-128436-29889000 Created pod: maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-inf-b-de7242-29889000 Created pod: maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000 Created pod: maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000 Created pod: maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 41m Normal AddedInterface pod/maas-api-key-cleanup-29889000-lkffl Add eth0 [10.134.0.102/23] from ovn-kubernetes 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj Add eth0 [10.132.0.123/23] from ovn-kubernetes 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-a35835 Created job maas-api-key-cleanup-e2e-worker-w5-a35835-29889000 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-inf-b-de7242 Created job maas-api-key-cleanup-e2e-inf-b-de7242-29889000 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000 Created pod: maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk 41m Normal Pulling pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000 Created pod: maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-b-4fc75f Created job maas-api-key-cleanup-e2e-api-b-4fc75f-29889000 41m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-128436 Created job maas-api-key-cleanup-e2e-worker-w3-128436-29889000 41m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000 Created pod: maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Add eth0 [10.134.0.101/23] from ovn-kubernetes 41m Normal Pulling pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Add eth0 [10.134.0.104/23] from ovn-kubernetes 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz Add eth0 [10.133.0.224/23] from ovn-kubernetes 41m Normal Killing pod/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj Stopping container cleanup 41m Normal Killing pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Stopping container maas-api 41m Normal Started pod/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj Container started 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk Add eth0 [10.132.0.121/23] from ovn-kubernetes 41m Normal Created pod/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj Container created 41m Normal Pulled pod/maas-api-key-cleanup-e2e-api-b-4fc75f-29889000-ws6wj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm Add eth0 [10.133.0.223/23] from ovn-kubernetes 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 Add eth0 [10.133.0.226/23] from ovn-kubernetes 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 Add eth0 [10.133.0.221/23] from ovn-kubernetes 41m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k Add eth0 [10.133.0.225/23] from ovn-kubernetes 41m Warning Unhealthy pod/maas-api-e2e-api-b-4fc75f-5d5864445b-9ppgj Readiness probe failed: Get "https://10.133.0.193:8443/health": context deadline exceeded 41m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5_odh-ai-gateway-infra(64a1b9f6-c4d4-433e-83d0-742c0a406ed4) 41m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 10.032s (10.032s including waiting). Image size: 107195206 bytes. 41m Normal Pulled pod/maas-api-key-cleanup-29889000-lkffl Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 10.395s (10.395s including waiting). Image size: 107195206 bytes. 41m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 10.346s (10.346s including waiting). Image size: 107195206 bytes. 41m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 10.316s (10.316s including waiting). Image size: 107195206 bytes. 41m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk Container created 41m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk Container started 41m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 Container created 41m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 Container started 41m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 Container started 41m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 Container created 41m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Pulled pod/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Started pod/maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch Container started 41m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw Container created 41m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k Container created 41m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw Container started 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 41m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276_odh-ai-gateway-infra(8814ac67-80a5-44d0-b25c-5751cc589ccf) 41m Normal Created pod/maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch Container created 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000 Deleted pod: maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000-wf276 41m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k Container started 41m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk 41m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000-fghsk_odh-ai-gateway-infra(a0e477b3-de84-4a4d-bedb-f47ea744632a) 41m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 Container started 41m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 Container created 41m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000-cg9b5 Container created 41m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 Container started 41m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd Container created 41m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd Container started 41m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm Container started 41m Normal Started pod/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t Container started 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-inf-b-de7242-29889000 Deleted pod: maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch 41m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll Container created 41m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll Container started 41m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4_odh-ai-gateway-infra(314aebbd-980a-49e5-a6e5-8b807c5eb4b8) 41m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm Container created 41m Normal Created pod/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t Container created 41m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000-lrgk4 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-128436-29889000 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k 41m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-128436-29889000-jvx7k_odh-ai-gateway-infra(91c5ed71-35d2-441a-a2b3-f3332c7c0980) 41m Warning BackOff pod/maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-inf-b-de7242-29889000-b5lch_odh-ai-gateway-infra(78d3f6b6-deef-4822-bac3-1adc7221f4f2) 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000 Job has reached the specified backoff limit 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-1354a5 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-1354a5-29889000, condition: Failed 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000 Job has reached the specified backoff limit 41m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw_odh-ai-gateway-infra(a7b36512-f641-4b2a-9cf9-f8deade880bc) 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w0-197e9b Saw completed job: maas-api-key-cleanup-e2e-worker-w0-197e9b-29889000, condition: Failed 41m Warning BackOff pod/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t_odh-ai-gateway-infra(0becf319-257f-4b48-87d6-788e15435d0e) 41m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2_odh-ai-gateway-infra(926d956d-0651-401b-8661-1cb2bd101f81) 41m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz Container created 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000-69tq2 41m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz Container started 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-c78066-29889000-kl6kw 41m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd_odh-ai-gateway-infra(263ee938-5a4a-43a9-bee6-41c00c03eacd) 41m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz_odh-ai-gateway-infra(9fac396a-8fbd-46d7-902b-662e1629b512) 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000 Job has reached the specified backoff limit 41m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll_odh-ai-gateway-infra(cb970e05-080d-4383-9003-2380f254d3ec) 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w6-477f6b Saw completed job: maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000, condition: Failed 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w4-815776 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w4-815776-29889000, condition: Failed 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889000 Job has reached the specified backoff limit 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000-5rqll 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-128436-29889000 Job has reached the specified backoff limit 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000 Deleted pod: maas-api-key-cleanup-e2e-api-a-84dc9d-29889000-5nq2t 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000-2q2nd 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-128436 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-128436-29889000, condition: Failed 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-inf-b-de7242-29889000 Job has reached the specified backoff limit 41m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000-ksmkm_odh-ai-gateway-infra(5f7922d7-702a-4a0a-a32a-fa8017c00540) 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-inf-b-de7242 Saw completed job: maas-api-key-cleanup-e2e-inf-b-de7242-29889000, condition: Failed 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-api-a-84dc9d Saw completed job: maas-api-key-cleanup-e2e-api-a-84dc9d-29889000, condition: Failed 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-c78066 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-c78066-29889000, condition: Failed 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000 Job has reached the specified backoff limit 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-c78066-29889000 Job has reached the specified backoff limit 41m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000-fldbz 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-4a68a1 Saw completed job: maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889000, condition: Failed 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-api-a-84dc9d-29889000 Job has reached the specified backoff limit 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb Saw completed job: maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000, condition: Failed 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e Saw completed job: maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000, condition: Failed 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889000 Job has reached the specified backoff limit 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000 Job has reached the specified backoff limit 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w6-f22a52 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889000, condition: Failed 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889000 Job has reached the specified backoff limit 41m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000, condition: Failed 41m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889000 Job has reached the specified backoff limit 41m Normal Created pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Container created 41m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal Started pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Container started 40m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000 Deleted pod: maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk 40m Warning BackOff pod/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-inf-a-862dc2-29889000-z9wzk_odh-ai-gateway-infra(445d826a-7d5f-442e-9b68-7aa53a386ab9) 40m Normal Pulled pod/maas-api-key-cleanup-29889000-lkffl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Container started 40m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Container created 40m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Container started 40m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 40m Normal Started pod/maas-api-key-cleanup-29889000-lkffl Container started 40m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Container created 40m Normal Created pod/maas-api-key-cleanup-29889000-lkffl Container created 40m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-inf-a-862dc2 Saw completed job: maas-api-key-cleanup-e2e-inf-a-862dc2-29889000, condition: Failed 40m Warning BackOff pod/maas-api-key-cleanup-29889000-lkffl Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29889000-lkffl_odh-ai-gateway-infra(76c281b8-0fe8-4556-88ac-121455f35366) 40m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-f4e35c-6d9884696c Created pod: maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv 40m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-f4e35c Scaled up replica set maas-api-e2e-inf-a-f4e35c-6d9884696c from 0 to 1 40m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-inf-a-862dc2-29889000 Job has reached the specified backoff limit 40m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg_odh-ai-gateway-infra(5f25d9e8-b19e-40c7-b986-33d65b0d21e8) 40m Normal AddedInterface pod/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv Add eth0 [10.133.0.238/23] from ovn-kubernetes 40m Normal SuccessfulDelete job/maas-api-key-cleanup-29889000 Deleted pod: maas-api-key-cleanup-29889000-lkffl 40m Normal Pulling pod/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000-s8wcg 40m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b 40m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-a35835-29889000-4wc2b_odh-ai-gateway-infra(23fe45ef-0047-4ffd-ae46-793506291ae4) 40m Normal Pulled pod/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 453ms (453ms including waiting). Image size: 194510193 bytes. 40m Normal Created pod/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv Container created 40m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29889000 Job has reached the specified backoff limit 40m Normal Started pod/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv Container started 40m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29889000, condition: Failed 40m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000 Job has reached the specified backoff limit 40m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-a35835-29889000 Job has reached the specified backoff limit 40m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-e2e3d0 Saw completed job: maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889000, condition: Failed 40m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-a35835 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-a35835-29889000, condition: Failed 40m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-c1d09f-5847bb6558 Created pod: maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj 40m Warning FailedMount pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-a-c1d09f-serving-cert" not found 40m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-c1d09f Scaled up replica set maas-api-e2e-inf-a-c1d09f-5847bb6558 from 0 to 1 40m Normal AddedInterface pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj Add eth0 [10.134.0.107/23] from ovn-kubernetes 40m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-aee070-5d5bcccc8f Created pod: maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb 40m Normal Started pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj Container started 40m Normal Pulling pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Warning FailedMount pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-a-aee070-serving-cert" not found 40m Normal Pulled pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 501ms (501ms including waiting). Image size: 194510193 bytes. 40m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-aee070 Scaled up replica set maas-api-e2e-inf-a-aee070-5d5bcccc8f from 0 to 1 40m Normal Created pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj Container created 40m Normal AddedInterface pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb Add eth0 [10.134.0.108/23] from ovn-kubernetes 40m Normal Pulling pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal Started pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb Container started 40m Normal Created pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb Container created 40m Normal Pulled pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 294ms (294ms including waiting). Image size: 194510193 bytes. 40m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-f78ca5-644d695967 Created pod: maas-api-e2e-api-b-f78ca5-644d695967-6bll9 40m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-f78ca5 Scaled up replica set maas-api-e2e-api-b-f78ca5-644d695967 from 0 to 1 40m Normal Started pod/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 Container started 40m Normal AddedInterface pod/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 Add eth0 [10.133.0.239/23] from ovn-kubernetes 40m Normal Created pod/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 Container created 40m Normal Pulled pod/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 389ms (389ms including waiting). Image size: 194510193 bytes. 40m Normal Pulling pod/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-387b16-7fb98899fb Created pod: maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd 40m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-387b16 Scaled up replica set maas-api-e2e-inf-a-387b16-7fb98899fb from 0 to 1 40m Normal AddedInterface pod/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd Add eth0 [10.134.0.109/23] from ovn-kubernetes 40m Normal Pulling pod/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal Started pod/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd Container started 40m Normal Created pod/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd Container created 40m Normal Pulled pod/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 373ms (373ms including waiting). Image size: 194510193 bytes. 39m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-84dc9d Created pod: maas-api-revoke-keys-e2e-api-a-84dc9d-xm4sp 39m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-84dc9d-xm4sp Add eth0 [10.132.0.125/23] from ovn-kubernetes 39m Normal Created pod/maas-api-revoke-keys-e2e-api-a-84dc9d-xm4sp Container created 39m Normal Started pod/maas-api-revoke-keys-e2e-api-a-84dc9d-xm4sp Container started 39m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-84dc9d-xm4sp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal Completed job/maas-api-revoke-keys-e2e-api-a-84dc9d Job completed 39m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-7df9fa Scaled up replica set maas-api-e2e-inf-a-7df9fa-6b874887b6 from 0 to 1 39m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-7df9fa-6b874887b6 Created pod: maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 39m Warning FailedMount pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-a-7df9fa-serving-cert" not found 39m Normal AddedInterface pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 Add eth0 [10.132.0.128/23] from ovn-kubernetes 39m Normal Pulling pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 39m Normal Pulled pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 511ms (511ms including waiting). Image size: 194510193 bytes. 39m Normal Started pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 Container started 39m Normal Created pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 Container created 39m Normal SuccessfulCreate job/maas-api-revoke-sub-13b4d176 Created pod: maas-api-revoke-sub-13b4d176-846c2 39m Normal Created pod/maas-api-revoke-sub-13b4d176-846c2 Container created 39m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-3cc570-6555f47d5f Created pod: maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 39m Normal Started pod/maas-api-revoke-sub-13b4d176-846c2 Container started 39m Normal Pulled pod/maas-api-revoke-sub-13b4d176-846c2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/maas-api-revoke-sub-13b4d176-846c2 Add eth0 [10.133.0.247/23] from ovn-kubernetes 39m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-3cc570 Scaled up replica set maas-api-e2e-inf-b-3cc570-6555f47d5f from 0 to 1 39m Normal Started pod/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 Container started 39m Normal Created pod/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 Container created 39m Normal Pulled pod/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 354ms (354ms including waiting). Image size: 194510193 bytes. 39m Normal Pulling pod/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 39m Normal AddedInterface pod/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 Add eth0 [10.132.0.129/23] from ovn-kubernetes 39m Normal Completed job/maas-api-revoke-sub-13b4d176 Job completed 39m Normal SuccessfulCreate job/maas-api-revoke-sub-edde6690 Created pod: maas-api-revoke-sub-edde6690-qj8wv 39m Normal Started pod/maas-api-revoke-sub-edde6690-qj8wv Container started 39m Normal Created pod/maas-api-revoke-sub-edde6690-qj8wv Container created 39m Normal Pulled pod/maas-api-revoke-sub-edde6690-qj8wv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 39m Normal AddedInterface pod/maas-api-revoke-sub-edde6690-qj8wv Add eth0 [10.133.0.248/23] from ovn-kubernetes 39m Normal Completed job/maas-api-revoke-sub-edde6690 Job completed 38m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-c54211-67b657bcc8 Created pod: maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x 38m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-c54211 Scaled up replica set maas-api-e2e-inf-b-c54211-67b657bcc8 from 0 to 1 38m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-62316c Scaled up replica set maas-api-e2e-inf-b-62316c-54b8877b4f from 0 to 1 38m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-62316c-54b8877b4f Created pod: maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz 38m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-7ad9ad-d668b84d8 Created pod: maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 38m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-7ad9ad Scaled up replica set maas-api-e2e-inf-b-7ad9ad-d668b84d8 from 0 to 1 38m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-862dc2 Created pod: maas-api-revoke-keys-e2e-inf-a-862dc2-6zzgb 38m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-862dc2-6zzgb Container created 38m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-862dc2-6zzgb Add eth0 [10.133.0.251/23] from ovn-kubernetes 38m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-862dc2-6zzgb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-862dc2-6zzgb Container started 38m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-862dc2 Job completed 38m Normal Killing pod/maas-api-e2e-api-a-84dc9d-7cf58856b8-7tfk4 Stopping container maas-api 38m Normal Started pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Container started 38m Normal AddedInterface pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Add eth0 [10.133.0.252/23] from ovn-kubernetes 38m Normal Pulled pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 352ms (352ms including waiting). Image size: 194510193 bytes. 38m Normal Created pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Container created 38m Normal Pulling pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 38m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-f78ca5 Created pod: maas-api-revoke-keys-e2e-api-b-f78ca5-2hq4x 38m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-f78ca5-2hq4x Add eth0 [10.133.0.253/23] from ovn-kubernetes 38m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-f78ca5-2hq4x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 38m Normal Started pod/maas-api-revoke-keys-e2e-api-b-f78ca5-2hq4x Container started 38m Normal Created pod/maas-api-revoke-keys-e2e-api-b-f78ca5-2hq4x Container created 38m Normal AddedInterface pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 Add eth0 [10.132.0.131/23] from ovn-kubernetes 38m Normal Pulling pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 38m Normal Pulled pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 371ms (371ms including waiting). Image size: 194510193 bytes. 38m Normal Created pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 Container created 38m Normal Started pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 Container started 38m Normal Completed job/maas-api-revoke-keys-e2e-api-b-f78ca5 Job completed 37m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-862dc2 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-862dc2: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-862dc2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-862dc2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dfeb82c6-7e26-4d0b-97e9-edd35a1ccd9f, UID in object meta: 37m Normal Killing pod/maas-api-e2e-inf-a-862dc2-69c5dffb64-p4knh Stopping container maas-api 37m Normal AddedInterface pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz Add eth0 [10.133.1.3/23] from ovn-kubernetes 37m Normal Pulling pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 37m Normal Pulled pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 487ms (487ms including waiting). Image size: 194510193 bytes. 37m Normal Created pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz Container created 37m Normal Started pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz Container started 37m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-de7242 Created pod: maas-api-revoke-keys-e2e-inf-b-de7242-l7dhk 37m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-de7242-l7dhk Add eth0 [10.133.1.5/23] from ovn-kubernetes 37m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-de7242-l7dhk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 37m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-de7242-l7dhk Container started 37m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-de7242-l7dhk Container created 37m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-de7242 Job completed 37m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-0d64c9 Scaled up replica set maas-api-e2e-inf-b-0d64c9-bd65566d from 0 to 1 37m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-0d64c9-bd65566d Created pod: maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz 37m Warning FailedMount pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-b-0d64c9-serving-cert" not found 37m Normal AddedInterface pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Add eth0 [10.133.1.7/23] from ovn-kubernetes 37m Normal Pulled pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 642ms (642ms including waiting). Image size: 194510193 bytes. 37m Normal Pulling pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 37m Normal Started pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Container started 37m Normal Created pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Container created 36m Normal Killing pod/maas-api-e2e-inf-b-de7242-6c494cd77d-m9qzp Stopping container maas-api 36m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-api-b-f78ca5 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-api-b-f78ca5: Operation cannot be fulfilled on endpoints "maas-api-e2e-api-b-f78ca5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-api-b-f78ca5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 81751879-9860-451f-8be1-fccc83dfa607, UID in object meta: 36m Normal Killing pod/maas-api-e2e-api-b-f78ca5-644d695967-6bll9 Stopping container maas-api 35m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w0-cfe14f Scaled up replica set maas-api-e2e-shared-a-w0-cfe14f-545bdbf888 from 0 to 1 35m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888 Created pod: maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb 35m Normal Started pod/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb Container started 35m Normal AddedInterface pod/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb Add eth0 [10.132.0.132/23] from ovn-kubernetes 35m Normal Pulling pod/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 35m Normal Pulled pod/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 379ms (379ms including waiting). Image size: 194510193 bytes. 35m Normal Created pod/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb Container created 35m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-d3e7e6 Scaled up replica set maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c from 0 to 1 35m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c Created pod: maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 35m Normal AddedInterface pod/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 Add eth0 [10.132.0.134/23] from ovn-kubernetes 35m Normal Pulling pod/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 35m Normal Pulled pod/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 418ms (418ms including waiting). Image size: 194510193 bytes. 35m Normal Started pod/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 Container started 35m Normal Created pod/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 Container created 35m Normal SuccessfulCreate job/maas-api-revoke-sub-db9e71ee Created pod: maas-api-revoke-sub-db9e71ee-bxccw 35m Normal AddedInterface pod/maas-api-revoke-sub-db9e71ee-bxccw Add eth0 [10.133.1.16/23] from ovn-kubernetes 35m Normal Pulled pod/maas-api-revoke-sub-db9e71ee-bxccw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal Started pod/maas-api-revoke-sub-db9e71ee-bxccw Container started 35m Normal Created pod/maas-api-revoke-sub-db9e71ee-bxccw Container created 34m Normal Completed job/maas-api-revoke-sub-db9e71ee Job completed 34m Normal SuccessfulCreate job/maas-api-revoke-sub-b0e3355f Created pod: maas-api-revoke-sub-b0e3355f-rsv2l 34m Normal Pulled pod/maas-api-revoke-sub-b0e3355f-rsv2l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal AddedInterface pod/maas-api-revoke-sub-b0e3355f-rsv2l Add eth0 [10.133.1.19/23] from ovn-kubernetes 34m Normal Started pod/maas-api-revoke-sub-b0e3355f-rsv2l Container started 34m Normal Created pod/maas-api-revoke-sub-b0e3355f-rsv2l Container created 34m Normal Completed job/maas-api-revoke-sub-b0e3355f Job completed 34m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-f4e35c Created pod: maas-api-revoke-keys-e2e-inf-a-f4e35c-lskhq 34m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-f4e35c-lskhq Add eth0 [10.133.1.20/23] from ovn-kubernetes 34m Warning FailedMount pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-b-w0-03d349-serving-cert" not found 34m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w0-03d349-57d58fb66c Created pod: maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw 34m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w0-03d349 Scaled up replica set maas-api-e2e-shared-b-w0-03d349-57d58fb66c from 0 to 1 34m Normal AddedInterface pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Add eth0 [10.132.0.138/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-f4e35c-lskhq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Pulling pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 34m Normal Created pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Container created 34m Normal Started pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Container started 34m Normal Pulled pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 386ms (386ms including waiting). Image size: 194510193 bytes. 34m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-f4e35c-lskhq Container started 34m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-f4e35c-lskhq Container created 34m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-f4e35c Job completed 34m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-0d0152-87db96b6b Created pod: maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 34m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-0d0152 Scaled up replica set maas-api-e2e-inf-b-0d0152-87db96b6b from 0 to 1 34m Normal Pulling pod/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 34m Normal Created pod/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 Container created 34m Normal AddedInterface pod/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 Add eth0 [10.132.0.139/23] from ovn-kubernetes 34m Normal Started pod/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 Container started 34m Normal Pulled pod/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 278ms (278ms including waiting). Image size: 194510193 bytes. 33m Normal SuccessfulCreate job/maas-api-revoke-sub-88df6884 Created pod: maas-api-revoke-sub-88df6884-pqffg 33m Normal SuccessfulCreate job/maas-api-revoke-sub-bb936e39 Created pod: maas-api-revoke-sub-bb936e39-kgpvn 33m Normal AddedInterface pod/maas-api-revoke-sub-88df6884-pqffg Add eth0 [10.133.1.22/23] from ovn-kubernetes 33m Normal Started pod/maas-api-revoke-sub-bb936e39-kgpvn Container started 33m Normal Created pod/maas-api-revoke-sub-bb936e39-kgpvn Container created 33m Normal Pulled pod/maas-api-revoke-sub-bb936e39-kgpvn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-sub-bb936e39-kgpvn Add eth0 [10.133.1.21/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-sub-88df6884-pqffg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Started pod/maas-api-revoke-sub-88df6884-pqffg Container started 33m Normal Created pod/maas-api-revoke-sub-88df6884-pqffg Container created 33m Normal Completed job/maas-api-revoke-sub-88df6884 Job completed 33m Normal Completed job/maas-api-revoke-sub-bb936e39 Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-sub-37ae9cd8 Created pod: maas-api-revoke-sub-37ae9cd8-zlt86 33m Normal SuccessfulCreate job/maas-api-revoke-sub-7b24fc33 Created pod: maas-api-revoke-sub-7b24fc33-j79bn 33m Normal AddedInterface pod/maas-api-revoke-sub-37ae9cd8-zlt86 Add eth0 [10.133.1.23/23] from ovn-kubernetes 33m Normal AddedInterface pod/maas-api-revoke-sub-7b24fc33-j79bn Add eth0 [10.133.1.24/23] from ovn-kubernetes 33m Normal Started pod/maas-api-revoke-sub-37ae9cd8-zlt86 Container started 33m Normal Created pod/maas-api-revoke-sub-37ae9cd8-zlt86 Container created 33m Normal Pulled pod/maas-api-revoke-sub-37ae9cd8-zlt86 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Pulled pod/maas-api-revoke-sub-7b24fc33-j79bn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Created pod/maas-api-revoke-sub-7b24fc33-j79bn Container created 33m Normal Started pod/maas-api-revoke-sub-7b24fc33-j79bn Container started 33m Normal Completed job/maas-api-revoke-sub-37ae9cd8 Job completed 33m Normal Completed job/maas-api-revoke-sub-7b24fc33 Job completed 33m Normal Killing pod/maas-api-e2e-inf-a-f4e35c-6d9884696c-rcpxv Stopping container maas-api 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-387b16 Created pod: maas-api-revoke-keys-e2e-inf-a-387b16-6pd8s 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-3cc570 Created pod: maas-api-revoke-keys-e2e-inf-b-3cc570-npbgx 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-387b16-6pd8s Add eth0 [10.133.1.25/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-387b16-6pd8s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-387b16-6pd8s Container created 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-3cc570-npbgx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-387b16-6pd8s Container started 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-3cc570-npbgx Add eth0 [10.133.1.26/23] from ovn-kubernetes 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-3cc570-npbgx Container created 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-3cc570-npbgx Container started 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-aee070 Created pod: maas-api-revoke-keys-e2e-inf-a-aee070-48g9r 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-aee070-48g9r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-aee070-48g9r Add eth0 [10.133.1.27/23] from ovn-kubernetes 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-aee070-48g9r Container started 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-aee070-48g9r Container created 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-387b16 Job completed 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-3cc570 Job completed 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-aee070 Job completed 33m Normal Killing pod/maas-api-e2e-inf-a-387b16-7fb98899fb-4pchd Stopping container maas-api 33m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-387b16 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-387b16: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-387b16": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-387b16, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c0b7c776-8319-40b6-a29d-54bbc9539d05, UID in object meta: 32m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-7ad9ad Created pod: maas-api-revoke-keys-e2e-inf-b-7ad9ad-dwj8b 32m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-7ad9ad-dwj8b Container started 32m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-7ad9ad-dwj8b Container created 32m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-7ad9ad-dwj8b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-7ad9ad-dwj8b Add eth0 [10.133.1.28/23] from ovn-kubernetes 32m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-7ad9ad Job completed 32m Normal Killing pod/maas-api-e2e-inf-b-3cc570-6555f47d5f-kbs94 Stopping container maas-api 32m Normal Killing pod/maas-api-e2e-inf-a-aee070-5d5bcccc8f-nnsmb Stopping container maas-api 32m Normal SuccessfulCreate job/maas-api-revoke-sub-680f1658 Created pod: maas-api-revoke-sub-680f1658-h6tpx 32m Normal AddedInterface pod/maas-api-revoke-sub-680f1658-h6tpx Add eth0 [10.133.1.31/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-sub-680f1658-h6tpx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Created pod/maas-api-revoke-sub-680f1658-h6tpx Container created 32m Normal Started pod/maas-api-revoke-sub-680f1658-h6tpx Container started 32m Normal Completed job/maas-api-revoke-sub-680f1658 Job completed 32m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-c54211 Created pod: maas-api-revoke-keys-e2e-inf-b-c54211-84h88 32m Normal SuccessfulCreate job/maas-api-revoke-sub-5e8c249a Created pod: maas-api-revoke-sub-5e8c249a-f96w8 32m Normal AddedInterface pod/maas-api-revoke-sub-5e8c249a-f96w8 Add eth0 [10.133.1.34/23] from ovn-kubernetes 32m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-c54211-84h88 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-c54211-84h88 Add eth0 [10.133.1.33/23] from ovn-kubernetes 32m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-c54211-84h88 Container started 32m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-c54211-84h88 Container created 32m Normal Pulled pod/maas-api-revoke-sub-5e8c249a-f96w8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Started pod/maas-api-revoke-sub-5e8c249a-f96w8 Container started 32m Normal Created pod/maas-api-revoke-sub-5e8c249a-f96w8 Container created 32m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-c54211 Job completed 32m Normal Completed job/maas-api-revoke-sub-5e8c249a Job completed 32m Normal Killing pod/maas-api-e2e-inf-b-7ad9ad-d668b84d8-bc798 Stopping container maas-api 31m Normal SuccessfulCreate job/maas-api-revoke-sub-a2d9b776 Created pod: maas-api-revoke-sub-a2d9b776-jmtdc 31m Normal Created pod/maas-api-revoke-sub-a2d9b776-jmtdc Container created 31m Normal Pulled pod/maas-api-revoke-sub-a2d9b776-jmtdc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-a2d9b776-jmtdc Add eth0 [10.133.1.36/23] from ovn-kubernetes 31m Normal Started pod/maas-api-revoke-sub-a2d9b776-jmtdc Container started 31m Normal Completed job/maas-api-revoke-sub-a2d9b776 Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-sub-7ee8e44e Created pod: maas-api-revoke-sub-7ee8e44e-5d72f 31m Normal Created pod/maas-api-revoke-sub-7ee8e44e-5d72f Container created 31m Normal Started pod/maas-api-revoke-sub-7ee8e44e-5d72f Container started 31m Normal Pulled pod/maas-api-revoke-sub-7ee8e44e-5d72f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal AddedInterface pod/maas-api-revoke-sub-7ee8e44e-5d72f Add eth0 [10.133.1.39/23] from ovn-kubernetes 31m Normal Completed job/maas-api-revoke-sub-7ee8e44e Job completed 31m Normal Killing pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Stopping container maas-api 31m Warning Unhealthy pod/maas-api-e2e-inf-b-c54211-67b657bcc8-9b75x Readiness probe failed: Get "https://10.133.0.252:8443/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-c1d09f Created pod: maas-api-revoke-keys-e2e-inf-a-c1d09f-z6mtv 31m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff Created pod: maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf 31m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-c1d09f-z6mtv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w5-d1bfce Scaled up replica set maas-api-e2e-shared-a-w5-d1bfce-64c44989ff from 0 to 1 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-c1d09f-z6mtv Add eth0 [10.133.1.44/23] from ovn-kubernetes 31m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-c1d09f-z6mtv Container created 31m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-c1d09f-z6mtv Container started 31m Warning FailedMount pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-a-w5-d1bfce-serving-cert" not found 31m Normal Pulled pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 403ms (403ms including waiting). Image size: 194510193 bytes. 31m Normal AddedInterface pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Add eth0 [10.133.1.45/23] from ovn-kubernetes 31m Normal Pulling pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 31m Normal Started pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Container started 31m Normal Created pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Container created 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-7df9fa Created pod: maas-api-revoke-keys-e2e-inf-a-7df9fa-bl5dz 31m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-c1d09f Job completed 31m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-7df9fa-bl5dz Container started 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-7df9fa-bl5dz Add eth0 [10.133.1.46/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-7df9fa-bl5dz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-7df9fa-bl5dz Container created 31m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-7df9fa Job completed 31m Normal Killing pod/maas-api-e2e-inf-a-c1d09f-5847bb6558-s26vj Stopping container maas-api 31m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-c1d09f Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-c1d09f: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-c1d09f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-c1d09f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 97183cdb-beab-433f-bdc3-10d521af74d9, UID in object meta: 30m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-62316c Created pod: maas-api-revoke-keys-e2e-inf-b-62316c-bbmf4 30m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-62316c-bbmf4 Container started 30m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-62316c-bbmf4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-62316c-bbmf4 Container created 30m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-62316c-bbmf4 Add eth0 [10.133.1.47/23] from ovn-kubernetes 30m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-62316c Job completed 30m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w1-24db22 Scaled up replica set maas-api-e2e-shared-a-w1-24db22-5d8467f488 from 0 to 1 30m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w1-24db22-5d8467f488 Created pod: maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb 30m Normal Pulled pod/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 329ms (329ms including waiting). Image size: 194510193 bytes. 30m Normal Pulling pod/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 30m Normal AddedInterface pod/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb Add eth0 [10.133.1.48/23] from ovn-kubernetes 30m Normal Started pod/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb Container started 30m Normal Created pod/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb Container created 30m Normal Killing pod/maas-api-e2e-inf-a-7df9fa-6b874887b6-dp6w6 Stopping container maas-api 30m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-0d64c9 Created pod: maas-api-revoke-keys-e2e-inf-b-0d64c9-xfb8l 30m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-0d64c9-xfb8l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-0d64c9-xfb8l Add eth0 [10.133.1.51/23] from ovn-kubernetes 30m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-0d64c9-xfb8l Container created 30m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-0d64c9-xfb8l Container started 30m Normal SuccessfulCreate job/maas-api-revoke-sub-a5a6380f Created pod: maas-api-revoke-sub-a5a6380f-9shx7 30m Normal AddedInterface pod/maas-api-revoke-sub-a5a6380f-9shx7 Add eth0 [10.133.1.52/23] from ovn-kubernetes 30m Normal Pulled pod/maas-api-revoke-sub-a5a6380f-9shx7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-revoke-sub-a5a6380f-9shx7 Container created 30m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-0d64c9 Job completed 30m Normal Started pod/maas-api-revoke-sub-a5a6380f-9shx7 Container started 30m Normal Completed job/maas-api-revoke-sub-a5a6380f Job completed 30m Normal Killing pod/maas-api-e2e-inf-b-62316c-54b8877b4f-wdmzz Stopping container maas-api 30m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-b-62316c Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-b-62316c: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-b-62316c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-b-62316c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2fd48701-192c-4ddd-8e24-a97eced234e2, UID in object meta: 30m Normal SuccessfulCreate job/maas-api-revoke-sub-74d02af5 Created pod: maas-api-revoke-sub-74d02af5-7ch6l 30m Normal Pulled pod/maas-api-revoke-sub-74d02af5-7ch6l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-sub-74d02af5-7ch6l Add eth0 [10.133.1.53/23] from ovn-kubernetes 30m Normal Created pod/maas-api-revoke-sub-74d02af5-7ch6l Container created 30m Normal Started pod/maas-api-revoke-sub-74d02af5-7ch6l Container started 30m Normal Killing pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Stopping container maas-api 30m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-b-0d64c9 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-b-0d64c9: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-b-0d64c9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-b-0d64c9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b85082bf-d443-45a2-b674-333caa2c4373, UID in object meta: 30m Normal Completed job/maas-api-revoke-sub-74d02af5 Job completed 30m Warning Unhealthy pod/maas-api-e2e-inf-b-0d64c9-bd65566d-sqbwz Readiness probe failed: Get "https://10.133.1.7:8443/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 30m Normal SuccessfulCreate job/maas-api-revoke-sub-c610016d Created pod: maas-api-revoke-sub-c610016d-vmpjd 30m Normal AddedInterface pod/maas-api-revoke-sub-c610016d-vmpjd Add eth0 [10.133.1.54/23] from ovn-kubernetes 30m Normal Pulled pod/maas-api-revoke-sub-c610016d-vmpjd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-revoke-sub-c610016d-vmpjd Container created 30m Normal Started pod/maas-api-revoke-sub-c610016d-vmpjd Container started 30m Normal Completed job/maas-api-revoke-sub-c610016d Job completed 29m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w5-91f42c Scaled up replica set maas-api-e2e-shared-b-w5-91f42c-585cd85b46 from 0 to 1 29m Normal AddedInterface pod/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 Add eth0 [10.133.1.59/23] from ovn-kubernetes 29m Normal Pulling pod/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 29m Normal Pulled pod/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 290ms (290ms including waiting). Image size: 194510193 bytes. 29m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w5-91f42c-585cd85b46 Created pod: maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 29m Normal Started pod/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 Container started 29m Normal Created pod/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 Container created 29m Normal SuccessfulCreate job/maas-api-revoke-sub-4431ec71 Created pod: maas-api-revoke-sub-4431ec71-rs2h4 29m Normal Created pod/maas-api-revoke-sub-4431ec71-rs2h4 Container created 29m Normal Pulled pod/maas-api-revoke-sub-4431ec71-rs2h4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-sub-4431ec71-rs2h4 Add eth0 [10.133.1.60/23] from ovn-kubernetes 29m Normal Started pod/maas-api-revoke-sub-4431ec71-rs2h4 Container started 29m Normal Completed job/maas-api-revoke-sub-4431ec71 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-5efbc29c Created pod: maas-api-revoke-sub-5efbc29c-vxsl9 29m Normal Pulled pod/maas-api-revoke-sub-5efbc29c-vxsl9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-sub-5efbc29c-vxsl9 Add eth0 [10.133.1.61/23] from ovn-kubernetes 29m Normal Created pod/maas-api-revoke-sub-5efbc29c-vxsl9 Container created 29m Normal Started pod/maas-api-revoke-sub-5efbc29c-vxsl9 Container started 29m Normal Completed job/maas-api-revoke-sub-5efbc29c Job completed 29m Normal AddedInterface pod/maas-api-revoke-sub-79b306a9-sgx9q Add eth0 [10.133.1.62/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-sub-79b306a9-sgx9q Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal SuccessfulCreate job/maas-api-revoke-sub-79b306a9 Created pod: maas-api-revoke-sub-79b306a9-sgx9q 29m Normal Started pod/maas-api-revoke-sub-79b306a9-sgx9q Container started 29m Normal Created pod/maas-api-revoke-sub-79b306a9-sgx9q Container created 29m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w1-0f980e Scaled up replica set maas-api-e2e-shared-b-w1-0f980e-694fc6f76f from 0 to 1 29m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f Created pod: maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 29m Normal AddedInterface pod/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 Add eth0 [10.132.0.151/23] from ovn-kubernetes 29m Normal Pulling pod/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 29m Normal Completed job/maas-api-revoke-sub-79b306a9 Job completed 29m Normal Created pod/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 Container created 29m Normal Started pod/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 Container started 29m Normal Pulled pod/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 396ms (396ms including waiting). Image size: 194510193 bytes. 29m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-d3e7e6 Created pod: maas-api-revoke-keys-e2e-inf-a-d3e7e6-j6jz8 29m Normal SuccessfulCreate job/maas-api-revoke-sub-ea494249 Created pod: maas-api-revoke-sub-ea494249-qbvcp 29m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-d3e7e6-j6jz8 Add eth0 [10.133.1.67/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-d3e7e6-j6jz8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Started pod/maas-api-revoke-sub-ea494249-qbvcp Container started 29m Normal Created pod/maas-api-revoke-sub-ea494249-qbvcp Container created 29m Normal Pulled pod/maas-api-revoke-sub-ea494249-qbvcp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-sub-ea494249-qbvcp Add eth0 [10.133.1.64/23] from ovn-kubernetes 29m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-d3e7e6-j6jz8 Container created 29m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-d3e7e6-j6jz8 Container started 29m Normal Completed job/maas-api-revoke-sub-ea494249 Job completed 29m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-d3e7e6 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-43dfbf61 Created pod: maas-api-revoke-sub-43dfbf61-mvd4w 29m Normal Started pod/maas-api-revoke-sub-43dfbf61-mvd4w Container started 29m Normal Pulled pod/maas-api-revoke-sub-43dfbf61-mvd4w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-sub-43dfbf61-mvd4w Container created 29m Normal AddedInterface pod/maas-api-revoke-sub-43dfbf61-mvd4w Add eth0 [10.133.1.68/23] from ovn-kubernetes 28m Normal Completed job/maas-api-revoke-sub-43dfbf61 Job completed 28m Normal Killing pod/maas-api-e2e-inf-a-d3e7e6-7cb9dcd64c-lmdh8 Stopping container maas-api 28m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-a-d3e7e6 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-a-d3e7e6: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-a-d3e7e6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-a-d3e7e6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fd1327a8-ac06-4493-860b-33c5a461017b, UID in object meta: 28m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-0d0152 Created pod: maas-api-revoke-keys-e2e-inf-b-0d0152-pz92k 28m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-0d0152-pz92k Container started 28m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-0d0152-pz92k Add eth0 [10.133.1.69/23] from ovn-kubernetes 28m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-0d0152-pz92k Container created 28m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-0d0152-pz92k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-db0540 Scaled up replica set maas-api-e2e-ipp-a-db0540-f7b489f56 from 0 to 1 28m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-db0540-f7b489f56 Created pod: maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 28m Normal Started pod/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 Container started 28m Normal AddedInterface pod/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 Add eth0 [10.132.0.153/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 362ms (362ms including waiting). Image size: 194510193 bytes. 28m Normal Created pod/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 Container created 28m Normal Pulling pod/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 28m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-0d0152 Job completed 28m Normal Killing pod/maas-api-e2e-inf-b-0d0152-87db96b6b-cvr29 Stopping container maas-api 28m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-b-0d0152 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-b-0d0152: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-b-0d0152": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-b-0d0152, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: efe551aa-6122-47aa-84e8-92860c91c3d9, UID in object meta: 27m Normal SuccessfulCreate job/maas-api-revoke-sub-af2bc828 Created pod: maas-api-revoke-sub-af2bc828-67vg5 27m Normal Started pod/maas-api-revoke-sub-af2bc828-67vg5 Container started 27m Normal AddedInterface pod/maas-api-revoke-sub-af2bc828-67vg5 Add eth0 [10.133.1.77/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-sub-af2bc828-67vg5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-sub-af2bc828-67vg5 Container created 27m Normal Completed job/maas-api-revoke-sub-af2bc828 Job completed 27m Normal AddedInterface pod/maas-api-revoke-sub-790f8f63-nlzc6 Add eth0 [10.133.1.78/23] from ovn-kubernetes 27m Normal SuccessfulCreate job/maas-api-revoke-sub-790f8f63 Created pod: maas-api-revoke-sub-790f8f63-nlzc6 27m Normal Pulled pod/maas-api-revoke-sub-790f8f63-nlzc6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Started pod/maas-api-revoke-sub-790f8f63-nlzc6 Container started 27m Normal Created pod/maas-api-revoke-sub-790f8f63-nlzc6 Container created 27m Normal Completed job/maas-api-revoke-sub-790f8f63 Job completed 27m Normal SuccessfulCreate job/maas-api-revoke-sub-96df05fe Created pod: maas-api-revoke-sub-96df05fe-q98v8 27m Normal AddedInterface pod/maas-api-revoke-sub-96df05fe-q98v8 Add eth0 [10.133.1.79/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-revoke-sub-96df05fe-q98v8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Created pod/maas-api-revoke-sub-96df05fe-q98v8 Container created 27m Normal Started pod/maas-api-revoke-sub-96df05fe-q98v8 Container started 27m Normal Completed job/maas-api-revoke-sub-96df05fe Job completed 27m Normal SuccessfulCreate job/maas-api-revoke-sub-70f0ecbd Created pod: maas-api-revoke-sub-70f0ecbd-qks5j 27m Normal Started pod/maas-api-revoke-sub-70f0ecbd-qks5j Container started 27m Normal AddedInterface pod/maas-api-revoke-sub-70f0ecbd-qks5j Add eth0 [10.133.1.80/23] from ovn-kubernetes 27m Normal Created pod/maas-api-revoke-sub-70f0ecbd-qks5j Container created 27m Normal Pulled pod/maas-api-revoke-sub-70f0ecbd-qks5j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal SuccessfulCreate job/maas-api-revoke-sub-1805ecc1 Created pod: maas-api-revoke-sub-1805ecc1-8bkvv 27m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f Created pod: maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m 27m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w2-25d881 Scaled up replica set maas-api-e2e-shared-a-w2-25d881-54bb4fc58f from 0 to 1 27m Normal AddedInterface pod/maas-api-revoke-sub-1805ecc1-8bkvv Add eth0 [10.133.1.81/23] from ovn-kubernetes 27m Normal Pulling pod/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 27m Normal Created pod/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m Container created 27m Normal Created pod/maas-api-revoke-sub-1805ecc1-8bkvv Container created 27m Normal Started pod/maas-api-revoke-sub-1805ecc1-8bkvv Container started 27m Normal AddedInterface pod/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m Add eth0 [10.132.0.158/23] from ovn-kubernetes 27m Normal Pulled pod/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 393ms (393ms including waiting). Image size: 194510193 bytes. 27m Normal Pulled pod/maas-api-revoke-sub-1805ecc1-8bkvv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal Completed job/maas-api-revoke-sub-70f0ecbd Job completed 27m Normal Started pod/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m Container started 27m Normal Completed job/maas-api-revoke-sub-1805ecc1 Job completed 27m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-dddc53 Scaled up replica set maas-api-e2e-ipp-a-dddc53-5d886d89b4 from 0 to 1 27m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-dddc53-5d886d89b4 Created pod: maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 27m Normal Pulled pod/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 332ms (332ms including waiting). Image size: 194510193 bytes. 27m Normal Pulling pod/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 27m Normal AddedInterface pod/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 Add eth0 [10.132.0.159/23] from ovn-kubernetes 27m Normal Created pod/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 Container created 27m Normal Started pod/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 Container started 27m Normal SuccessfulCreate job/maas-api-revoke-sub-acf0c297 Created pod: maas-api-revoke-sub-acf0c297-wv27m 27m Normal Pulled pod/maas-api-revoke-sub-acf0c297-wv27m Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 27m Normal AddedInterface pod/maas-api-revoke-sub-acf0c297-wv27m Add eth0 [10.133.1.82/23] from ovn-kubernetes 27m Normal Created pod/maas-api-revoke-sub-acf0c297-wv27m Container created 27m Normal Started pod/maas-api-revoke-sub-acf0c297-wv27m Container started 27m Normal Completed job/maas-api-revoke-sub-acf0c297 Job completed 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w6-477f6b Created job maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015 Created pod: maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w 26m Normal SuccessfulCreate job/maas-api-key-cleanup-29889015 Created pod: maas-api-key-cleanup-29889015-tlp2q 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-1354a5 Created job maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015 Created pod: maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015 Created pod: maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-ipp-a-db0540 Created job maas-api-key-cleanup-e2e-ipp-a-db0540-29889015 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-a35835 Created job maas-api-key-cleanup-e2e-worker-w5-a35835-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015 Created pod: maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015 Created pod: maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-e2e3d0 Created job maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015 Created pod: maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-ipp-a-dddc53 Created job maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-128436 Created job maas-api-key-cleanup-e2e-worker-w3-128436-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-128436-29889015 Created pod: maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015 Created pod: maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-c78066 Created job maas-api-key-cleanup-e2e-worker-w2-c78066-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015 Created pod: maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f Created job maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-4a68a1 Created job maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015 Created pod: maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015 Created pod: maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015 Created pod: maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w1-24db22 Created job maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w2-25d881 Created job maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk Add eth0 [10.134.0.157/23] from ovn-kubernetes 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-197e9b Created job maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015 Created pod: maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015 Created pod: maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w6-f22a52 Created job maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015 Created pod: maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e Created job maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w5-91f42c Created job maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015 Created pod: maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g Add eth0 [10.132.0.160/23] from ovn-kubernetes 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015 Created pod: maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w4-815776 Created job maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px Add eth0 [10.133.1.89/23] from ovn-kubernetes 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3 Created job maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015 Created pod: maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w0-03d349 Created job maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015 Created pod: maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce Created job maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr Add eth0 [10.132.0.161/23] from ovn-kubernetes 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb Created job maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015 Created pod: maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015 Created pod: maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w1-0f980e Created job maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015 26m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015 Created pod: maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 26m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29889015 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw Add eth0 [10.134.0.158/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww Add eth0 [10.133.1.93/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-29889015-tlp2q Add eth0 [10.134.0.160/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 Add eth0 [10.134.0.164/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn Add eth0 [10.132.0.162/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp Add eth0 [10.133.1.94/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w Add eth0 [10.134.0.163/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 Add eth0 [10.132.0.163/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm Add eth0 [10.133.1.97/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt Add eth0 [10.133.1.99/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 Add eth0 [10.133.1.98/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm Add eth0 [10.133.1.92/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv Add eth0 [10.134.0.161/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn Add eth0 [10.133.1.90/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb Add eth0 [10.134.0.162/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz Add eth0 [10.133.1.96/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg Add eth0 [10.133.1.91/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l Add eth0 [10.133.1.95/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp Add eth0 [10.134.0.159/23] from ovn-kubernetes 26m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-2d4576 Scaled up replica set maas-api-e2e-ipp-b-2d4576-86565c8454 from 0 to 1 26m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-2d4576-86565c8454 Created pod: maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk 26m Warning FailedMount pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-b-2d4576-serving-cert" not found 26m Normal Created pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk Container created 26m Normal Started pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk Container started 26m Normal AddedInterface pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk Add eth0 [10.132.0.164/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 376ms (376ms including waiting). Image size: 194510193 bytes. 26m Normal Pulling pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 Container created 26m Normal Pulled pod/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g Container created 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015-vc78g_odh-ai-gateway-infra(8015f2f2-498e-4eb2-92b5-e5cd89b3352a) 26m Normal Pulled pod/maas-api-key-cleanup-29889015-tlp2q Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-key-cleanup-29889015-tlp2q Container created 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-29889015-tlp2q Container started 26m Warning BackOff pod/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9_odh-ai-gateway-infra(72b6bd70-d8ba-47d4-acb0-580158cb262c) 26m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015 Deleted pod: maas-api-key-cleanup-e2e-ipp-a-db0540-29889015-px5v9 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn Container created 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px Container started 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr Container created 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr Container started 26m Warning BackOff pod/maas-api-key-cleanup-29889015-tlp2q Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29889015-tlp2q_odh-ai-gateway-infra(c3ade289-2392-4add-800c-9070a5a965ac) 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px Container created 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm Container created 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn Container created 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulDelete job/maas-api-key-cleanup-29889015 Deleted pod: maas-api-key-cleanup-29889015-tlp2q 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn Container started 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm 26m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm Container created 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015-vm5cm_odh-ai-gateway-infra(a49655a2-0273-48ad-a6ae-6751667e17ff) 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w4-815776 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w4-815776-29889015 Job has reached the specified backoff limit 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr_odh-ai-gateway-infra(f31f6f0e-e534-48bd-bf2c-9f49feda0561) 26m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px_odh-ai-gateway-infra(bbb83f9d-19b3-4a42-947a-081e19c55622) 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015-hf2px 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw Container created 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw Container started 26m Normal Pulled pod/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w Container created 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb Container created 26m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb Container started 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn_odh-ai-gateway-infra(7f801879-e408-4b05-acac-db0dac8e0f41) 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015-brndn 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 Container started 26m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb_odh-ai-gateway-infra(f56bf106-551f-46ec-b4ea-c8f6890dd29b) 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l Container created 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l Container started 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29889015 Job has reached the specified backoff limit 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk Container started 26m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww Container created 26m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm_odh-ai-gateway-infra(ee7ab0c7-25ea-42c1-9a86-07b5abc968ce) 26m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt Container created 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w_odh-ai-gateway-infra(fce43331-a061-418e-87ee-cb48df2fc345) 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn_odh-ai-gateway-infra(932116d1-8f96-472d-8dd1-5a08f275db18) 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk Container created 26m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp Container created 26m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 Container created 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw_odh-ai-gateway-infra(732c537b-6fa6-40db-aec8-5720bd35f93d) 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-ipp-a-db0540 Saw completed job: maas-api-key-cleanup-e2e-ipp-a-db0540-29889015, condition: Failed 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29889015, condition: Failed 26m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv Container started 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015-4nkmm 26m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv Container created 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-ipp-a-db0540-29889015 Job has reached the specified backoff limit 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk_odh-ai-gateway-infra(ae284910-6e7d-419b-ad60-814f27522558) 26m Warning BackOff pod/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt_odh-ai-gateway-infra(f38bd9ab-ce56-41ea-978d-faa7f57f8a09) 26m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv_odh-ai-gateway-infra(38e8d144-5ea8-406c-bed8-c85a44336b68) 26m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww_odh-ai-gateway-infra(5d0fd932-4293-4670-a1e7-ffea84b24d29) 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015-zwjbr 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015-l4gsw 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015-9zl2w 26m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65_odh-ai-gateway-infra(81e40a21-5725-4637-bbc6-31bb193af0cf) 26m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp_odh-ai-gateway-infra(25609759-f118-43eb-bbd2-3f42e12da38f) 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w0-cfe14f Saw completed job: maas-api-key-cleanup-e2e-shared-a-w0-cfe14f-29889015, condition: Failed 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-a35835-29889015-wcl65 26m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 Container created 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l_odh-ai-gateway-infra(ae2fbf77-9ad7-492d-8908-7dedfa97665c) 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015 Deleted pod: maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015-7dcdt 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-128436-29889015 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-128436-29889015-pnpxb 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w4-cc33d3 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w4-cc33d3-29889015, condition: Failed 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015-4kxvv 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-128436 Saw completed job: maas-api-key-cleanup-e2e-worker-w3-128436-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-128436-29889015 Job has reached the specified backoff limit 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015-4gb9l 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz Container created 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015-7nhww 26m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4_odh-ai-gateway-infra(a733495c-f173-4a82-b3a2-cb6bf48aa83d) 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015 Deleted pod: maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015-t8gkp 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w6-f22a52 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w6-f22a52-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce Saw completed job: maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w5-d1bfce-29889015 Job has reached the specified backoff limit 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015 Job has reached the specified backoff limit 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015-nd6nn 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w2-25d881 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w2-25d881-29889015, condition: Failed 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015-cpqvk 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w5-91f42c Saw completed job: maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w5-91f42c-29889015 Job has reached the specified backoff limit 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015 Job has reached the specified backoff limit 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-e2e3d0 Saw completed job: maas-api-key-cleanup-e2e-worker-w4-e2e3d0-29889015, condition: Failed 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-1354a5 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015, condition: Failed 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w0-197e9b Saw completed job: maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015, condition: Failed 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e Saw completed job: maas-api-key-cleanup-e2e-shared-a-w3-6b5b1e-29889015, condition: Failed 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg Container created 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb Saw completed job: maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w3-c73fcb-29889015 Job has reached the specified backoff limit 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-1354a5-29889015 Job has reached the specified backoff limit 26m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz_odh-ai-gateway-infra(a11e045d-1571-44f4-843a-67cad6d0d07f) 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w0-197e9b-29889015 Job has reached the specified backoff limit 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015-gwdc4 26m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg Container started 26m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp Container created 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-a35835 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-a35835-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w1-0f980e Saw completed job: maas-api-key-cleanup-e2e-shared-b-w1-0f980e-29889015, condition: Failed 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-c78066-29889015-hrtdz 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w0-03d349 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w0-03d349-29889015, condition: Failed 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-ipp-a-dddc53 Saw completed job: maas-api-key-cleanup-e2e-ipp-a-dddc53-29889015, condition: Failed 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp_odh-ai-gateway-infra(9d8eb99f-1e3e-4ec8-afd0-f77a83adfa66) 26m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg_odh-ai-gateway-infra(1375bbc9-4ccb-4173-bde3-8b9e22f8d731) 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015 Job has reached the specified backoff limit 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-a35835-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-4a68a1 Saw completed job: maas-api-key-cleanup-e2e-worker-w1-4a68a1-29889015, condition: Failed 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015-mpfkp 26m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015-7m5hg 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-c78066-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-c78066 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-c78066-29889015, condition: Failed 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015 Job has reached the specified backoff limit 26m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015 Job has reached the specified backoff limit 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w1-24db22 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w1-24db22-29889015, condition: Failed 26m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w6-477f6b Saw completed job: maas-api-key-cleanup-e2e-shared-a-w6-477f6b-29889015, condition: Failed 25m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd Created pod: maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz 25m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-bf87e1 Scaled up replica set maas-api-e2e-ipp-a-bf87e1-6774bdcbcd from 0 to 1 25m Warning FailedMount pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-a-bf87e1-serving-cert" not found 25m Normal Started pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz Container started 25m Normal AddedInterface pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz Add eth0 [10.133.1.102/23] from ovn-kubernetes 25m Normal Pulling pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 25m Normal Created pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz Container created 25m Normal Pulled pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 365ms (365ms including waiting). Image size: 194510193 bytes. 25m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-dfc3d2-74884884cf Created pod: maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx 25m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-dfc3d2 Scaled up replica set maas-api-e2e-ipp-a-dfc3d2-74884884cf from 0 to 1 25m Normal Pulled pod/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 406ms (406ms including waiting). Image size: 194510193 bytes. 25m Normal Created pod/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx Container created 25m Normal Started pod/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx Container started 25m Normal Pulling pod/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 25m Normal AddedInterface pod/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx Add eth0 [10.134.0.168/23] from ovn-kubernetes 25m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w2-f6302c-8657c48c94 Created pod: maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj 25m Normal Pulling pod/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 25m Normal SuccessfulCreate job/maas-api-revoke-sub-83ed428d Created pod: maas-api-revoke-sub-83ed428d-7mlcp 25m Normal AddedInterface pod/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj Add eth0 [10.132.0.168/23] from ovn-kubernetes 25m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w2-f6302c Scaled up replica set maas-api-e2e-shared-b-w2-f6302c-8657c48c94 from 0 to 1 25m Normal Pulled pod/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 325ms (325ms including waiting). Image size: 194510193 bytes. 25m Normal Created pod/maas-api-revoke-sub-83ed428d-7mlcp Container created 25m Normal AddedInterface pod/maas-api-revoke-sub-83ed428d-7mlcp Add eth0 [10.133.1.105/23] from ovn-kubernetes 25m Normal Started pod/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj Container started 25m Normal Started pod/maas-api-revoke-sub-83ed428d-7mlcp Container started 25m Normal Pulled pod/maas-api-revoke-sub-83ed428d-7mlcp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Created pod/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj Container created 25m Normal Completed job/maas-api-revoke-sub-83ed428d Job completed 25m Normal SuccessfulCreate job/maas-api-revoke-sub-e0d15423 Created pod: maas-api-revoke-sub-e0d15423-7sqkp 25m Normal AddedInterface pod/maas-api-revoke-sub-e0d15423-7sqkp Add eth0 [10.133.1.106/23] from ovn-kubernetes 25m Normal Created pod/maas-api-revoke-sub-e0d15423-7sqkp Container created 25m Normal Pulled pod/maas-api-revoke-sub-e0d15423-7sqkp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Started pod/maas-api-revoke-sub-e0d15423-7sqkp Container started 25m Normal Completed job/maas-api-revoke-sub-e0d15423 Job completed 25m Normal SuccessfulCreate job/maas-api-revoke-sub-e4187f4a Created pod: maas-api-revoke-sub-e4187f4a-fsxs5 25m Normal AddedInterface pod/maas-api-revoke-sub-e4187f4a-fsxs5 Add eth0 [10.133.1.110/23] from ovn-kubernetes 25m Normal Pulled pod/maas-api-revoke-sub-e4187f4a-fsxs5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Started pod/maas-api-revoke-sub-e4187f4a-fsxs5 Container started 25m Normal Created pod/maas-api-revoke-sub-e4187f4a-fsxs5 Container created 25m Normal Completed job/maas-api-revoke-sub-e4187f4a Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-89c98f1e Created pod: maas-api-revoke-sub-89c98f1e-rr5k8 24m Normal AddedInterface pod/maas-api-revoke-sub-89c98f1e-rr5k8 Add eth0 [10.133.1.111/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-sub-89c98f1e-rr5k8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal Created pod/maas-api-revoke-sub-89c98f1e-rr5k8 Container created 24m Normal Started pod/maas-api-revoke-sub-89c98f1e-rr5k8 Container started 24m Normal Completed job/maas-api-revoke-sub-89c98f1e Job completed 24m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f Created pod: maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks 24m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-f7ad21 Scaled up replica set maas-api-e2e-ipp-b-f7ad21-6b469d4b6f from 0 to 1 24m Warning FailedMount pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-b-f7ad21-serving-cert" not found 24m Normal AddedInterface pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks Add eth0 [10.134.0.171/23] from ovn-kubernetes 24m Normal Pulling pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 24m Normal Created pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks Container created 24m Normal Started pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks Container started 24m Normal Pulled pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 413ms (413ms including waiting). Image size: 194510193 bytes. 24m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-db0540-2cvtj Add eth0 [10.133.1.115/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-db0540-2cvtj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-db0540 Created pod: maas-api-revoke-keys-e2e-ipp-a-db0540-2cvtj 24m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-db0540-2cvtj Container created 24m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-db0540-2cvtj Container started 24m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-db0540 Job completed 23m Normal Killing pod/maas-api-e2e-ipp-a-db0540-f7b489f56-mmjb8 Stopping container maas-api 23m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-2d4576 Created pod: maas-api-revoke-keys-e2e-ipp-b-2d4576-vx6ns 23m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-2d4576-vx6ns Container started 23m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-2d4576-vx6ns Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-2d4576-vx6ns Container created 23m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-2d4576-vx6ns Add eth0 [10.133.1.122/23] from ovn-kubernetes 23m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-2d4576 Job completed 22m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-d51cd8-58d79c77d5 Created pod: maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 22m Warning FailedMount pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-b-d51cd8-serving-cert" not found 22m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-d51cd8 Scaled up replica set maas-api-e2e-ipp-b-d51cd8-58d79c77d5 from 0 to 1 22m Normal Pulling pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 22m Normal AddedInterface pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 Add eth0 [10.132.0.172/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 380ms (380ms including waiting). Image size: 194510193 bytes. 22m Normal Started pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 Container started 22m Normal Created pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 Container created 22m Normal Killing pod/maas-api-e2e-ipp-b-2d4576-86565c8454-7cmnk Stopping container maas-api 22m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ipp-b-2d4576 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d4576: Operation cannot be fulfilled on endpoints "maas-api-e2e-ipp-b-2d4576": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ipp-b-2d4576, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e7f8fcd0-582a-4697-907f-39325d9dfadd, UID in object meta: 22m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-5deb36 Scaled up replica set maas-api-e2e-ipp-b-5deb36-6c7b7c955c from 0 to 1 22m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-5deb36-6c7b7c955c Created pod: maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk 22m Warning FailedMount pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-b-5deb36-serving-cert" not found 22m Normal AddedInterface pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk Add eth0 [10.132.0.173/23] from ovn-kubernetes 22m Normal Pulling pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 22m Normal Pulled pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 351ms (351ms including waiting). Image size: 194510193 bytes. 22m Normal Created pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk Container created 22m Normal Started pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk Container started 22m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f-5r4vw Add eth0 [10.133.1.123/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f-5r4vw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f Created pod: maas-api-revoke-keys-e2e-shared-a-w0-cfe14f-5r4vw 22m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f-5r4vw Container created 22m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f-5r4vw Container started 22m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w0-cfe14f Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-dddc53 Created pod: maas-api-revoke-keys-e2e-ipp-a-dddc53-tqvvf 22m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-dddc53-tqvvf Container created 22m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-dddc53-tqvvf Container started 22m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-dddc53-tqvvf Add eth0 [10.133.1.126/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-dddc53-tqvvf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-dddc53 Job completed 22m Normal SuccessfulCreate job/maas-api-revoke-sub-c4a6368c Created pod: maas-api-revoke-sub-c4a6368c-r62mq 21m Normal Pulled pod/maas-api-revoke-sub-c4a6368c-r62mq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Started pod/maas-api-revoke-sub-c4a6368c-r62mq Container started 21m Normal Created pod/maas-api-revoke-sub-c4a6368c-r62mq Container created 21m Normal AddedInterface pod/maas-api-revoke-sub-c4a6368c-r62mq Add eth0 [10.133.1.127/23] from ovn-kubernetes 21m Normal Completed job/maas-api-revoke-sub-c4a6368c Job completed 21m Normal Killing pod/maas-api-e2e-shared-a-w0-cfe14f-545bdbf888-dvvfb Stopping container maas-api 21m Normal SuccessfulCreate job/maas-api-revoke-sub-e9a9d6b1 Created pod: maas-api-revoke-sub-e9a9d6b1-q97pz 21m Normal Pulled pod/maas-api-revoke-sub-e9a9d6b1-q97pz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-sub-e9a9d6b1-q97pz Container created 21m Normal Started pod/maas-api-revoke-sub-e9a9d6b1-q97pz Container started 21m Normal AddedInterface pod/maas-api-revoke-sub-e9a9d6b1-q97pz Add eth0 [10.133.1.128/23] from ovn-kubernetes 21m Warning Unhealthy pod/postgres-7cdbf6dc44-p64x4 Readiness probe failed: command timed out 21m Normal Completed job/maas-api-revoke-sub-e9a9d6b1 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w0-03d349 Created pod: maas-api-revoke-keys-e2e-shared-b-w0-03d349-k5nbw 21m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w0-03d349-k5nbw Add eth0 [10.133.1.129/23] from ovn-kubernetes 21m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w0-03d349-k5nbw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w0-03d349-k5nbw Container created 21m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w0-03d349-k5nbw Container started 21m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w0-03d349 Job completed 21m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce Created pod: maas-api-revoke-keys-e2e-shared-a-w5-d1bfce-4nfkw 21m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce-4nfkw Add eth0 [10.133.1.133/23] from ovn-kubernetes 21m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce-4nfkw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce-4nfkw Container created 21m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce-4nfkw Container started 21m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w5-d1bfce Job completed 21m Normal Killing pod/maas-api-e2e-ipp-a-dddc53-5d886d89b4-jfhn4 Stopping container maas-api 20m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-f7ad21 Created pod: maas-api-revoke-keys-e2e-ipp-b-f7ad21-kxmfc 20m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-f7ad21-kxmfc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-f7ad21-kxmfc Add eth0 [10.133.1.135/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-f7ad21-kxmfc Container started 20m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-f7ad21-kxmfc Container created 20m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-f7ad21 Job completed 20m Normal Killing pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Stopping container maas-api 20m Warning Unhealthy pod/maas-api-e2e-shared-b-w0-03d349-57d58fb66c-6mprw Readiness probe failed: Get "https://10.132.0.138:8443/health": dial tcp 10.132.0.138:8443: connect: connection refused 20m Normal Killing pod/maas-api-e2e-ipp-b-f7ad21-6b469d4b6f-nw2ks Stopping container maas-api 20m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w0-197e9b Created pod: maas-api-revoke-keys-e2e-worker-w0-197e9b-qpbhk 20m Warning Unhealthy pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Readiness probe failed: Get "https://10.133.1.45:8443/health": dial tcp 10.133.1.45:8443: connect: connection refused 20m Normal Killing pod/maas-api-e2e-shared-a-w5-d1bfce-64c44989ff-n5pzf Stopping container maas-api 20m Normal Started pod/maas-api-revoke-keys-e2e-worker-w0-197e9b-qpbhk Container started 20m Normal Created pod/maas-api-revoke-keys-e2e-worker-w0-197e9b-qpbhk Container created 20m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w0-197e9b-qpbhk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w0-197e9b-qpbhk Add eth0 [10.133.1.141/23] from ovn-kubernetes 20m Normal Completed job/maas-api-revoke-keys-e2e-worker-w0-197e9b Job completed 20m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-dfc3d2 Created pod: maas-api-revoke-keys-e2e-ipp-a-dfc3d2-zjzqb 20m Normal AddedInterface pod/maas-api-revoke-sub-4a9918b1-gnddj Add eth0 [10.133.1.142/23] from ovn-kubernetes 20m Normal Pulled pod/maas-api-revoke-sub-4a9918b1-gnddj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal SuccessfulCreate job/maas-api-revoke-sub-4a9918b1 Created pod: maas-api-revoke-sub-4a9918b1-gnddj 20m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-dfc3d2-zjzqb Container created 20m Normal Created pod/maas-api-revoke-sub-4a9918b1-gnddj Container created 20m Normal Started pod/maas-api-revoke-sub-4a9918b1-gnddj Container started 20m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-dfc3d2-zjzqb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-dfc3d2-zjzqb Container started 20m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-dfc3d2-zjzqb Add eth0 [10.133.1.143/23] from ovn-kubernetes 20m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w6-477f6b Created pod: maas-api-revoke-keys-e2e-shared-a-w6-477f6b-xzhsb 20m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w6-477f6b-xzhsb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal Completed job/maas-api-revoke-sub-4a9918b1 Job completed 20m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w6-477f6b-xzhsb Add eth0 [10.133.1.144/23] from ovn-kubernetes 20m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w6-477f6b-xzhsb Container created 20m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w6-477f6b-xzhsb Container started 20m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w5-91f42c Created pod: maas-api-revoke-keys-e2e-shared-b-w5-91f42c-zqklm 20m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-dfc3d2 Job completed 20m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w5-91f42c-zqklm Container created 20m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w5-91f42c-zqklm Container started 20m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w5-91f42c-zqklm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w5-91f42c-zqklm Add eth0 [10.133.1.145/23] from ovn-kubernetes 20m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w6-477f6b Job completed 20m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w5-91f42c Job completed 20m Normal SuccessfulCreate job/maas-api-revoke-sub-0eb6584f Created pod: maas-api-revoke-sub-0eb6584f-29682 20m Normal Started pod/maas-api-revoke-sub-0eb6584f-29682 Container started 20m Normal AddedInterface pod/maas-api-revoke-sub-0eb6584f-29682 Add eth0 [10.133.1.146/23] from ovn-kubernetes 20m Normal Created pod/maas-api-revoke-sub-0eb6584f-29682 Container created 20m Normal Pulled pod/maas-api-revoke-sub-0eb6584f-29682 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal Completed job/maas-api-revoke-sub-0eb6584f Job completed 20m Normal Killing pod/maas-api-e2e-ipp-a-dfc3d2-74884884cf-47ldx Stopping container maas-api 20m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ipp-a-dfc3d2 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ipp-a-dfc3d2: Operation cannot be fulfilled on endpoints "maas-api-e2e-ipp-a-dfc3d2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ipp-a-dfc3d2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c35f4c10-6f10-416a-9428-f1d529884bfb, UID in object meta: 20m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-5deb36 Created pod: maas-api-revoke-keys-e2e-ipp-b-5deb36-4qhbz 20m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-5deb36-4qhbz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-5deb36-4qhbz Add eth0 [10.133.1.147/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-5deb36-4qhbz Container started 20m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-5deb36-4qhbz Container created 20m Normal SuccessfulCreate job/maas-api-revoke-sub-51398201 Created pod: maas-api-revoke-sub-51398201-cwfkf 20m Normal Pulled pod/maas-api-revoke-sub-51398201-cwfkf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal AddedInterface pod/maas-api-revoke-sub-51398201-cwfkf Add eth0 [10.133.1.148/23] from ovn-kubernetes 20m Normal Started pod/maas-api-revoke-sub-51398201-cwfkf Container started 20m Normal Created pod/maas-api-revoke-sub-51398201-cwfkf Container created 20m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-5deb36 Job completed 20m Normal Completed job/maas-api-revoke-sub-51398201 Job completed 19m Normal SuccessfulCreate job/maas-api-revoke-sub-bc55c08a Created pod: maas-api-revoke-sub-bc55c08a-ggvwk 19m Normal SuccessfulCreate job/maas-api-revoke-sub-45ce7185 Created pod: maas-api-revoke-sub-45ce7185-dzxd2 19m Normal Started pod/maas-api-revoke-sub-45ce7185-dzxd2 Container started 19m Normal Pulled pod/maas-api-revoke-sub-45ce7185-dzxd2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-sub-45ce7185-dzxd2 Add eth0 [10.133.1.149/23] from ovn-kubernetes 19m Normal Started pod/maas-api-revoke-sub-bc55c08a-ggvwk Container started 19m Normal Created pod/maas-api-revoke-sub-45ce7185-dzxd2 Container created 19m Normal AddedInterface pod/maas-api-revoke-sub-bc55c08a-ggvwk Add eth0 [10.133.1.150/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-revoke-sub-bc55c08a-ggvwk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Created pod/maas-api-revoke-sub-bc55c08a-ggvwk Container created 19m Normal AddedInterface pod/maas-api-revoke-sub-14fa4301-kk5lv Add eth0 [10.133.1.151/23] from ovn-kubernetes 19m Normal SuccessfulCreate job/maas-api-revoke-sub-14fa4301 Created pod: maas-api-revoke-sub-14fa4301-kk5lv 19m Normal Created pod/maas-api-revoke-sub-14fa4301-kk5lv Container created 19m Normal Started pod/maas-api-revoke-sub-14fa4301-kk5lv Container started 19m Normal Pulled pod/maas-api-revoke-sub-14fa4301-kk5lv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Completed job/maas-api-revoke-sub-45ce7185 Job completed 19m Normal Completed job/maas-api-revoke-sub-bc55c08a Job completed 19m Normal Completed job/maas-api-revoke-sub-14fa4301 Job completed 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w1-24db22 Created pod: maas-api-revoke-keys-e2e-shared-a-w1-24db22-kcnfh 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w1-24db22-kcnfh Add eth0 [10.133.1.152/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w1-24db22-kcnfh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Killing pod/maas-api-e2e-shared-b-w5-91f42c-585cd85b46-zj5l9 Stopping container maas-api 19m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w1-24db22-kcnfh Container started 19m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w1-24db22-kcnfh Container created 19m Normal Killing pod/maas-api-e2e-shared-a-w6-477f6b-78c65f767-lvl45 Stopping container maas-api 19m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-a-w6-477f6b Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-477f6b: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-a-w6-477f6b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-477f6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 04340c07-57ac-4501-bd7c-58e7da5f9096, UID in object meta: 19m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w1-24db22 Job completed 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w5-a35835 Created pod: maas-api-revoke-keys-e2e-worker-w5-a35835-gd9hf 19m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w5-a35835-gd9hf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w5-a35835-gd9hf Add eth0 [10.133.1.153/23] from ovn-kubernetes 19m Normal Started pod/maas-api-revoke-keys-e2e-worker-w5-a35835-gd9hf Container started 19m Normal Created pod/maas-api-revoke-keys-e2e-worker-w5-a35835-gd9hf Container created 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w6-f22a52 Created pod: maas-api-revoke-keys-e2e-shared-b-w6-f22a52-45jdc 19m Normal Completed job/maas-api-revoke-keys-e2e-worker-w5-a35835 Job completed 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w6-f22a52-45jdc Add eth0 [10.133.1.154/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w6-f22a52-45jdc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w6-f22a52-45jdc Container created 19m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w6-f22a52-45jdc Container started 19m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w6-f22a52 Job completed 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-bf87e1-mf6fs Add eth0 [10.133.1.155/23] from ovn-kubernetes 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-bf87e1 Created pod: maas-api-revoke-keys-e2e-ipp-a-bf87e1-mf6fs 19m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-bf87e1-mf6fs Container created 19m Normal Killing pod/maas-api-e2e-ipp-b-5deb36-6c7b7c955c-g8rkk Stopping container maas-api 19m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-bf87e1-mf6fs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-bf87e1-mf6fs Container started 19m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-bf87e1 Job completed 19m Normal Killing pod/maas-api-e2e-shared-a-w1-24db22-5d8467f488-tjbdb Stopping container maas-api 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e Created pod: maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e-d7v58 19m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e-d7v58 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e-d7v58 Add eth0 [10.133.1.156/23] from ovn-kubernetes 19m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e-d7v58 Container started 19m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e-d7v58 Container created 19m Normal Killing pod/maas-api-e2e-worker-w0-197e9b-6c9f984757-fpzqd Stopping container maas-api 19m Normal SuccessfulCreate job/maas-api-revoke-sub-c761b88d Created pod: maas-api-revoke-sub-c761b88d-6v9xg 19m Normal SuccessfulCreate job/maas-api-revoke-sub-9155c284 Created pod: maas-api-revoke-sub-9155c284-wwq45 19m Normal Pulled pod/maas-api-revoke-sub-c761b88d-6v9xg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-sub-c761b88d-6v9xg Add eth0 [10.133.1.159/23] from ovn-kubernetes 19m Normal AddedInterface pod/maas-api-revoke-sub-9155c284-wwq45 Add eth0 [10.133.1.158/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-revoke-sub-9155c284-wwq45 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Created pod/maas-api-revoke-sub-9155c284-wwq45 Container created 19m Normal Started pod/maas-api-revoke-sub-9155c284-wwq45 Container started 19m Normal Started pod/maas-api-revoke-sub-c761b88d-6v9xg Container started 19m Normal Created pod/maas-api-revoke-sub-c761b88d-6v9xg Container created 19m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w3-6b5b1e Job completed 19m Normal SuccessfulCreate job/maas-api-revoke-sub-6a043a72 Created pod: maas-api-revoke-sub-6a043a72-fk9j5 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w1-0f980e Created pod: maas-api-revoke-keys-e2e-shared-b-w1-0f980e-4sph5 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w1-0f980e-4sph5 Add eth0 [10.133.1.161/23] from ovn-kubernetes 19m Normal AddedInterface pod/maas-api-revoke-sub-6a043a72-fk9j5 Add eth0 [10.133.1.162/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w1-0f980e-4sph5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w1-0f980e-4sph5 Container created 19m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w1-0f980e-4sph5 Container started 19m Normal Started pod/maas-api-revoke-sub-6a043a72-fk9j5 Container started 19m Normal Created pod/maas-api-revoke-sub-6a043a72-fk9j5 Container created 19m Normal Pulled pod/maas-api-revoke-sub-6a043a72-fk9j5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Completed job/maas-api-revoke-sub-c761b88d Job completed 19m Normal Completed job/maas-api-revoke-sub-9155c284 Job completed 19m Normal Completed job/maas-api-revoke-sub-6a043a72 Job completed 19m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w1-0f980e Job completed 18m Normal Killing pod/maas-api-e2e-shared-b-w6-f22a52-7c87c958cb-4tjqt Stopping container maas-api 18m Normal Killing pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Stopping container maas-api 18m Warning Unhealthy pod/maas-api-e2e-shared-a-w3-6b5b1e-5546447df9-sr7n8 Readiness probe failed: Get "https://10.134.0.76:8443/health": dial tcp 10.134.0.76:8443: connect: connection refused 18m Normal Killing pod/maas-api-e2e-shared-b-w1-0f980e-694fc6f76f-nhnt2 Stopping container maas-api 18m Normal Killing pod/maas-api-e2e-worker-w5-a35835-77d7f7496d-xtsgr Stopping container maas-api 18m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-1685dd-856c9558d9 Created pod: maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j 18m Normal Pulling pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 18m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-1685dd Scaled up replica set maas-api-e2e-ipp-a-1685dd-856c9558d9 from 0 to 1 18m Normal AddedInterface pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Add eth0 [10.133.1.164/23] from ovn-kubernetes 18m Normal Pulled pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 387ms (387ms including waiting). Image size: 194510193 bytes. 18m Normal Created pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Container created 18m Normal Started pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Container started 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w6-1354a5 Created pod: maas-api-revoke-keys-e2e-worker-w6-1354a5-9x69s 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w6-1354a5-9x69s Add eth0 [10.133.1.165/23] from ovn-kubernetes 18m Normal Started pod/maas-api-revoke-keys-e2e-worker-w6-1354a5-9x69s Container started 18m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w6-1354a5-9x69s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Created pod/maas-api-revoke-keys-e2e-worker-w6-1354a5-9x69s Container created 18m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ipp-a-bf87e1 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf87e1: Operation cannot be fulfilled on endpoints "maas-api-e2e-ipp-a-bf87e1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf87e1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 93c9fbc6-fa51-438c-8f2e-cc34237c413e, UID in object meta: 18m Normal Killing pod/maas-api-e2e-ipp-a-bf87e1-6774bdcbcd-44wrz Stopping container maas-api 18m Normal Completed job/maas-api-revoke-keys-e2e-worker-w6-1354a5 Job completed 18m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w1-4a68a1-7lct7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w1-4a68a1-7lct7 Add eth0 [10.133.1.166/23] from ovn-kubernetes 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb Created pod: maas-api-revoke-keys-e2e-shared-b-w3-c73fcb-9zzx2 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w1-4a68a1 Created pod: maas-api-revoke-keys-e2e-worker-w1-4a68a1-7lct7 18m Normal Started pod/maas-api-revoke-keys-e2e-worker-w1-4a68a1-7lct7 Container started 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb-9zzx2 Add eth0 [10.133.1.167/23] from ovn-kubernetes 18m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb-9zzx2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Created pod/maas-api-revoke-keys-e2e-worker-w1-4a68a1-7lct7 Container created 18m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb-9zzx2 Container created 18m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb-9zzx2 Container started 18m Normal Completed job/maas-api-revoke-keys-e2e-worker-w1-4a68a1 Job completed 18m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w3-c73fcb Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-sub-36f3c7aa Created pod: maas-api-revoke-sub-36f3c7aa-hzxkd 18m Normal SuccessfulCreate job/maas-api-revoke-sub-95eb23c9 Created pod: maas-api-revoke-sub-95eb23c9-q95d4 18m Normal AddedInterface pod/maas-api-revoke-sub-95eb23c9-q95d4 Add eth0 [10.133.1.168/23] from ovn-kubernetes 18m Normal AddedInterface pod/maas-api-revoke-sub-36f3c7aa-hzxkd Add eth0 [10.133.1.169/23] from ovn-kubernetes 18m Normal Pulled pod/maas-api-revoke-sub-36f3c7aa-hzxkd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Created pod/maas-api-revoke-sub-36f3c7aa-hzxkd Container created 18m Normal Started pod/maas-api-revoke-sub-36f3c7aa-hzxkd Container started 18m Normal Started pod/maas-api-revoke-sub-95eb23c9-q95d4 Container started 18m Normal Created pod/maas-api-revoke-sub-95eb23c9-q95d4 Container created 18m Normal Pulled pod/maas-api-revoke-sub-95eb23c9-q95d4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Completed job/maas-api-revoke-sub-95eb23c9 Job completed 18m Normal Completed job/maas-api-revoke-sub-36f3c7aa Job completed 18m Normal Killing pod/maas-api-e2e-shared-b-w3-c73fcb-885c74b49-l5p8q Stopping container maas-api 18m Normal SuccessfulCreate job/maas-api-revoke-sub-2e17309f Created pod: maas-api-revoke-sub-2e17309f-w8gqt 18m Normal SuccessfulCreate job/maas-api-revoke-sub-8c2c519e Created pod: maas-api-revoke-sub-8c2c519e-57b45 18m Normal AddedInterface pod/maas-api-revoke-sub-2e17309f-w8gqt Add eth0 [10.133.1.171/23] from ovn-kubernetes 18m Normal Pulled pod/maas-api-revoke-sub-2e17309f-w8gqt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Pulled pod/maas-api-revoke-sub-8c2c519e-57b45 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-sub-8c2c519e-57b45 Add eth0 [10.133.1.170/23] from ovn-kubernetes 18m Normal Created pod/maas-api-revoke-sub-2e17309f-w8gqt Container created 18m Normal Created pod/maas-api-revoke-sub-8c2c519e-57b45 Container created 18m Normal Started pod/maas-api-revoke-sub-2e17309f-w8gqt Container started 18m Normal Started pod/maas-api-revoke-sub-8c2c519e-57b45 Container started 18m Normal Completed job/maas-api-revoke-sub-2e17309f Job completed 18m Normal Completed job/maas-api-revoke-sub-8c2c519e Job completed 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w3-128436-vqhw8 Add eth0 [10.133.1.172/23] from ovn-kubernetes 18m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w3-128436-vqhw8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w3-128436 Created pod: maas-api-revoke-keys-e2e-worker-w3-128436-vqhw8 18m Normal Created pod/maas-api-revoke-keys-e2e-worker-w3-128436-vqhw8 Container created 18m Normal Started pod/maas-api-revoke-keys-e2e-worker-w3-128436-vqhw8 Container started 18m Normal Completed job/maas-api-revoke-keys-e2e-worker-w3-128436 Job completed 17m Normal Killing pod/maas-api-e2e-worker-w6-1354a5-6d4fc55f9c-rxxwl Stopping container maas-api 17m Normal Killing pod/maas-api-e2e-worker-w1-4a68a1-574f9c8cc8-bbg6n Stopping container maas-api 17m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-w1-4a68a1 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-w1-4a68a1: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-w1-4a68a1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-w1-4a68a1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0f642f2d-fb66-46bb-a967-9cef0b90033f, UID in object meta: 17m Normal SuccessfulCreate job/maas-api-revoke-sub-cb1505f7 Created pod: maas-api-revoke-sub-cb1505f7-hmxdq 17m Normal SuccessfulCreate job/maas-api-revoke-sub-264cef08 Created pod: maas-api-revoke-sub-264cef08-7b7h5 17m Normal Started pod/maas-api-revoke-sub-264cef08-7b7h5 Container started 17m Normal Created pod/maas-api-revoke-sub-264cef08-7b7h5 Container created 17m Normal Created pod/maas-api-revoke-sub-cb1505f7-hmxdq Container created 17m Normal Started pod/maas-api-revoke-sub-cb1505f7-hmxdq Container started 17m Normal AddedInterface pod/maas-api-revoke-sub-264cef08-7b7h5 Add eth0 [10.133.1.176/23] from ovn-kubernetes 17m Normal AddedInterface pod/maas-api-revoke-sub-cb1505f7-hmxdq Add eth0 [10.133.1.175/23] from ovn-kubernetes 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-d51cd8 Created pod: maas-api-revoke-keys-e2e-ipp-b-d51cd8-gxf62 17m Normal Pulled pod/maas-api-revoke-sub-264cef08-7b7h5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Pulled pod/maas-api-revoke-sub-cb1505f7-hmxdq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-d51cd8-gxf62 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-d51cd8-gxf62 Add eth0 [10.134.0.191/23] from ovn-kubernetes 17m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-d51cd8-gxf62 Container created 17m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-d51cd8-gxf62 Container started 17m Normal Completed job/maas-api-revoke-sub-264cef08 Job completed 17m Normal Completed job/maas-api-revoke-sub-cb1505f7 Job completed 17m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-d51cd8 Job completed 17m Normal Killing pod/maas-api-e2e-ipp-b-d51cd8-58d79c77d5-qrk76 Stopping container maas-api 17m Normal Killing pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Stopping container maas-api 17m Warning Unhealthy pod/maas-api-e2e-worker-w3-128436-767b6d9869-c9rsn Readiness probe failed: Get "https://10.132.0.59:8443/health": dial tcp 10.132.0.59:8443: connect: connection refused 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w4-815776 Created pod: maas-api-revoke-keys-e2e-shared-a-w4-815776-s65vs 17m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-630fdf Scaled up replica set maas-api-e2e-ipp-b-630fdf-844986f489 from 0 to 1 17m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-630fdf-844986f489 Created pod: maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 17m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w4-815776-s65vs Container started 17m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w4-815776-s65vs Container created 17m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w4-815776-s65vs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w4-815776-s65vs Add eth0 [10.133.1.177/23] from ovn-kubernetes 17m Normal Pulling pod/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 17m Normal AddedInterface pod/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 Add eth0 [10.133.1.178/23] from ovn-kubernetes 17m Normal Started pod/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 Container started 17m Normal Created pod/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 Container created 17m Normal Pulled pod/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 536ms (536ms including waiting). Image size: 194510193 bytes. 17m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w4-815776 Job completed 16m Normal Killing pod/maas-api-e2e-shared-a-w4-815776-54cf7c64bc-kdt9w Stopping container maas-api 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3 Created pod: maas-api-revoke-keys-e2e-shared-b-w4-cc33d3-xfkb5 16m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3-xfkb5 Container started 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3-xfkb5 Add eth0 [10.132.0.183/23] from ovn-kubernetes 16m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3-xfkb5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3-xfkb5 Container created 16m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w4-cc33d3 Job completed 16m Normal Killing pod/maas-api-e2e-shared-b-w4-cc33d3-69f7cfc5df-svf29 Stopping container maas-api 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-1685dd Created pod: maas-api-revoke-keys-e2e-ipp-a-1685dd-tfmp2 16m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-1685dd-tfmp2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-1685dd-tfmp2 Add eth0 [10.133.1.179/23] from ovn-kubernetes 16m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-1685dd-tfmp2 Container created 16m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-1685dd-tfmp2 Container started 16m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-1685dd Job completed 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w4-e2e3d0 Created pod: maas-api-revoke-keys-e2e-worker-w4-e2e3d0-z7xhj 16m Normal Started pod/maas-api-revoke-keys-e2e-worker-w4-e2e3d0-z7xhj Container started 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w4-e2e3d0-z7xhj Add eth0 [10.133.1.180/23] from ovn-kubernetes 16m Normal Created pod/maas-api-revoke-keys-e2e-worker-w4-e2e3d0-z7xhj Container created 16m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w4-e2e3d0-z7xhj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal Completed job/maas-api-revoke-keys-e2e-worker-w4-e2e3d0 Job completed 16m Warning Unhealthy pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Readiness probe failed: Get "https://10.133.1.164:8443/health": dial tcp 10.133.1.164:8443: connect: connection refused 16m Normal Killing pod/maas-api-e2e-ipp-a-1685dd-856c9558d9-vb44j Stopping container maas-api 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-630fdf Created pod: maas-api-revoke-keys-e2e-ipp-b-630fdf-c58b4 15m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-630fdf-c58b4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-630fdf-c58b4 Container created 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-630fdf-c58b4 Add eth0 [10.133.1.181/23] from ovn-kubernetes 15m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-630fdf-c58b4 Container started 15m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-630fdf Job completed 15m Normal Created pod/maas-api-revoke-sub-3c520a6f-2lrht Container created 15m Normal Created pod/maas-api-revoke-sub-2878804e-dgzbm Container created 15m Normal SuccessfulCreate job/maas-api-revoke-sub-3c520a6f Created pod: maas-api-revoke-sub-3c520a6f-2lrht 15m Normal Started pod/maas-api-revoke-sub-3c520a6f-2lrht Container started 15m Normal Started pod/maas-api-revoke-sub-2878804e-dgzbm Container started 15m Normal Pulled pod/maas-api-revoke-sub-3c520a6f-2lrht Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-sub-2878804e-dgzbm Add eth0 [10.133.1.183/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-sub-2878804e Created pod: maas-api-revoke-sub-2878804e-dgzbm 15m Normal AddedInterface pod/maas-api-revoke-sub-3c520a6f-2lrht Add eth0 [10.133.1.182/23] from ovn-kubernetes 15m Normal Pulled pod/maas-api-revoke-sub-2878804e-dgzbm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Completed job/maas-api-revoke-sub-2878804e Job completed 15m Normal Completed job/maas-api-revoke-sub-3c520a6f Job completed 15m Normal Killing pod/maas-api-e2e-ipp-b-630fdf-844986f489-5vwn5 Stopping container maas-api 15m Normal Killing pod/maas-api-e2e-worker-w4-e2e3d0-66c774896c-jcrjk Stopping container maas-api 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w2-25d881 Created pod: maas-api-revoke-keys-e2e-shared-a-w2-25d881-zv5bg 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w2-25d881-zv5bg Add eth0 [10.133.1.184/23] from ovn-kubernetes 15m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w2-25d881-zv5bg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w2-25d881-zv5bg Container started 15m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w2-25d881-zv5bg Container created 15m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w2-25d881 Job completed 15m Normal Killing pod/maas-api-e2e-shared-a-w2-25d881-54bb4fc58f-v5w6m Stopping container maas-api 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w2-f6302c Created pod: maas-api-revoke-keys-e2e-shared-b-w2-f6302c-xbx85 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w2-f6302c-xbx85 Add eth0 [10.133.1.185/23] from ovn-kubernetes 15m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w2-f6302c-xbx85 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w2-f6302c-xbx85 Container started 15m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w2-f6302c-xbx85 Container created 15m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w2-f6302c Job completed 15m Normal Killing pod/maas-api-e2e-shared-b-w2-f6302c-8657c48c94-m2whj Stopping container maas-api 14m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w2-c78066 Created pod: maas-api-revoke-keys-e2e-worker-w2-c78066-2vqlt 14m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w2-c78066-2vqlt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w2-c78066-2vqlt Add eth0 [10.133.1.186/23] from ovn-kubernetes 14m Normal Started pod/maas-api-revoke-keys-e2e-worker-w2-c78066-2vqlt Container started 14m Normal Created pod/maas-api-revoke-keys-e2e-worker-w2-c78066-2vqlt Container created 14m Normal Completed job/maas-api-revoke-keys-e2e-worker-w2-c78066 Job completed 14m Normal SuccessfulCreate job/maas-api-revoke-sub-c3562a41 Created pod: maas-api-revoke-sub-c3562a41-cq24s 14m Normal SuccessfulCreate job/maas-api-revoke-sub-35f05329 Created pod: maas-api-revoke-sub-35f05329-9mcg2 14m Normal AddedInterface pod/maas-api-revoke-sub-c3562a41-cq24s Add eth0 [10.132.0.184/23] from ovn-kubernetes 14m Normal Started pod/maas-api-revoke-sub-c3562a41-cq24s Container started 14m Normal Pulled pod/maas-api-revoke-sub-35f05329-9mcg2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal Created pod/maas-api-revoke-sub-c3562a41-cq24s Container created 14m Normal Pulled pod/maas-api-revoke-sub-c3562a41-cq24s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal Created pod/maas-api-revoke-sub-35f05329-9mcg2 Container created 14m Normal Started pod/maas-api-revoke-sub-35f05329-9mcg2 Container started 14m Normal AddedInterface pod/maas-api-revoke-sub-35f05329-9mcg2 Add eth0 [10.133.1.187/23] from ovn-kubernetes 14m Normal Completed job/maas-api-revoke-sub-c3562a41 Job completed 14m Normal Completed job/maas-api-revoke-sub-35f05329 Job completed 14m Normal Killing pod/maas-api-e2e-worker-w2-c78066-5fb6dcf77b-phvbp Stopping container maas-api 13m Normal SuccessfulCreate job/maas-api-revoke-sub-85237e45 Created pod: maas-api-revoke-sub-85237e45-92lt2 13m Normal AddedInterface pod/maas-api-revoke-sub-85237e45-92lt2 Add eth0 [10.133.1.189/23] from ovn-kubernetes 13m Normal Pulled pod/maas-api-revoke-sub-85237e45-92lt2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal Created pod/maas-api-revoke-sub-85237e45-92lt2 Container created 13m Normal Started pod/maas-api-revoke-sub-85237e45-92lt2 Container started 13m Normal Completed job/maas-api-revoke-sub-85237e45 Job completed 12m Normal SuccessfulCreate job/maas-api-revoke-sub-c1e271a9 Created pod: maas-api-revoke-sub-c1e271a9-kq2vv 12m Normal Pulled pod/maas-api-revoke-sub-c1e271a9-kq2vv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal Started pod/maas-api-revoke-sub-c1e271a9-kq2vv Container started 12m Normal AddedInterface pod/maas-api-revoke-sub-c1e271a9-kq2vv Add eth0 [10.133.1.192/23] from ovn-kubernetes 12m Normal Created pod/maas-api-revoke-sub-c1e271a9-kq2vv Container created 12m Normal Completed job/maas-api-revoke-sub-c1e271a9 Job completed 12m Normal SuccessfulCreate job/maas-api-revoke-sub-2e1f5b5f Created pod: maas-api-revoke-sub-2e1f5b5f-q5tb6 12m Normal Pulled pod/maas-api-revoke-sub-2e1f5b5f-q5tb6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal Created pod/maas-api-revoke-sub-2e1f5b5f-q5tb6 Container created 12m Normal Started pod/maas-api-revoke-sub-2e1f5b5f-q5tb6 Container started 12m Normal AddedInterface pod/maas-api-revoke-sub-2e1f5b5f-q5tb6 Add eth0 [10.133.1.194/23] from ovn-kubernetes 12m Normal Completed job/maas-api-revoke-sub-2e1f5b5f Job completed 12m Normal SuccessfulCreate job/maas-api-revoke-sub-ec843018 Created pod: maas-api-revoke-sub-ec843018-h7nh8 12m Normal Pulled pod/maas-api-revoke-sub-ec843018-h7nh8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal AddedInterface pod/maas-api-revoke-sub-ec843018-h7nh8 Add eth0 [10.133.1.195/23] from ovn-kubernetes 12m Normal Created pod/maas-api-revoke-sub-ec843018-h7nh8 Container created 12m Normal Started pod/maas-api-revoke-sub-ec843018-h7nh8 Container started 12m Normal Completed job/maas-api-revoke-sub-ec843018 Job completed 11m Normal Pulled pod/maas-api-revoke-sub-046e1343-5xrlr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal AddedInterface pod/maas-api-revoke-sub-046e1343-5xrlr Add eth0 [10.133.1.196/23] from ovn-kubernetes 11m Normal SuccessfulCreate job/maas-api-revoke-sub-046e1343 Created pod: maas-api-revoke-sub-046e1343-5xrlr 11m Normal Created pod/maas-api-revoke-sub-046e1343-5xrlr Container created 11m Normal Started pod/maas-api-revoke-sub-046e1343-5xrlr Container started 11m Normal Completed job/maas-api-revoke-sub-046e1343 Job completed 11m Normal SuccessfulCreate job/maas-api-revoke-sub-d3fba056 Created pod: maas-api-revoke-sub-d3fba056-8wm79 11m Normal AddedInterface pod/maas-api-revoke-sub-d3fba056-8wm79 Add eth0 [10.133.1.197/23] from ovn-kubernetes 11m Normal Pulled pod/maas-api-revoke-sub-d3fba056-8wm79 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal Created pod/maas-api-revoke-sub-d3fba056-8wm79 Container created 11m Normal Started pod/maas-api-revoke-sub-d3fba056-8wm79 Container started 11m Normal Completed job/maas-api-revoke-sub-d3fba056 Job completed 11m Normal AddedInterface pod/maas-api-revoke-sub-ae594979-kwqmx Add eth0 [10.133.1.198/23] from ovn-kubernetes 11m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29889030 11m Normal SuccessfulCreate job/maas-api-revoke-sub-ae594979 Created pod: maas-api-revoke-sub-ae594979-kwqmx 11m Normal Started pod/maas-api-revoke-sub-ae594979-kwqmx Container started 11m Normal Created pod/maas-api-revoke-sub-ae594979-kwqmx Container created 11m Normal Pulled pod/maas-api-revoke-sub-ae594979-kwqmx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal SuccessfulCreate job/maas-api-key-cleanup-29889030 Created pod: maas-api-key-cleanup-29889030-kvrng 11m Normal AddedInterface pod/maas-api-key-cleanup-29889030-kvrng Add eth0 [10.132.0.188/23] from ovn-kubernetes 11m Normal Completed job/maas-api-revoke-sub-ae594979 Job completed 11m Normal Created pod/maas-api-key-cleanup-29889030-kvrng Container created 11m Normal Started pod/maas-api-key-cleanup-29889030-kvrng Container started 11m Normal Pulled pod/maas-api-key-cleanup-29889030-kvrng Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Warning BackOff pod/maas-api-key-cleanup-29889030-kvrng Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29889030-kvrng_odh-ai-gateway-infra(ab63b18e-5ad9-4686-93cd-51686ee0fd8d) 11m Normal SuccessfulDelete job/maas-api-key-cleanup-29889030 Deleted pod: maas-api-key-cleanup-29889030-kvrng 11m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29889030, condition: Failed 11m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29889030 Job has reached the specified backoff limit 11m Normal SuccessfulDelete cronjob/maas-api-key-cleanup Deleted job maas-api-key-cleanup-29888985 11m Normal SuccessfulCreate job/maas-api-revoke-sub-a4aef7d7 Created pod: maas-api-revoke-sub-a4aef7d7-ljcw4 11m Normal AddedInterface pod/maas-api-revoke-sub-a4aef7d7-ljcw4 Add eth0 [10.133.1.199/23] from ovn-kubernetes 11m Normal Pulled pod/maas-api-revoke-sub-a4aef7d7-ljcw4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal Created pod/maas-api-revoke-sub-a4aef7d7-ljcw4 Container created 11m Normal Started pod/maas-api-revoke-sub-a4aef7d7-ljcw4 Container started 11m Normal Completed job/maas-api-revoke-sub-a4aef7d7 Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-79805ca9 Created pod: maas-api-revoke-sub-79805ca9-j8wv2 10m Normal Started pod/maas-api-revoke-sub-79805ca9-j8wv2 Container started 10m Normal Created pod/maas-api-revoke-sub-79805ca9-j8wv2 Container created 10m Normal AddedInterface pod/maas-api-revoke-sub-79805ca9-j8wv2 Add eth0 [10.133.1.200/23] from ovn-kubernetes 10m Normal Pulled pod/maas-api-revoke-sub-79805ca9-j8wv2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal Completed job/maas-api-revoke-sub-79805ca9 Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-0b7e8edb Created pod: maas-api-revoke-sub-0b7e8edb-pz4qf 10m Normal Started pod/maas-api-revoke-sub-0b7e8edb-pz4qf Container started 10m Normal Created pod/maas-api-revoke-sub-0b7e8edb-pz4qf Container created 10m Normal AddedInterface pod/maas-api-revoke-sub-0b7e8edb-pz4qf Add eth0 [10.133.1.201/23] from ovn-kubernetes 10m Normal Pulled pod/maas-api-revoke-sub-0b7e8edb-pz4qf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal Completed job/maas-api-revoke-sub-0b7e8edb Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-pgmj9 10m Normal Started pod/maas-api-revoke-sub-3d4156f1-pgmj9 Container started 10m Normal Created pod/maas-api-revoke-sub-3d4156f1-pgmj9 Container created 10m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-pgmj9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-pgmj9 Add eth0 [10.133.1.202/23] from ovn-kubernetes 10m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 9m50s Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-d6xdn 9m49s Normal Created pod/maas-api-revoke-sub-3d4156f1-d6xdn Container created 9m49s Normal Pulled pod/maas-api-revoke-sub-3d4156f1-d6xdn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 9m49s Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-d6xdn Add eth0 [10.133.1.203/23] from ovn-kubernetes 9m49s Normal Started pod/maas-api-revoke-sub-3d4156f1-d6xdn Container started 9m46s Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 9m25s Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-9xczs Add eth0 [10.133.1.204/23] from ovn-kubernetes 9m25s Normal Pulled pod/maas-api-revoke-sub-3d4156f1-9xczs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 9m25s Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-9xczs 9m24s Normal Created pod/maas-api-revoke-sub-3d4156f1-9xczs Container created 9m24s Normal Started pod/maas-api-revoke-sub-3d4156f1-9xczs Container started 9m21s Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 8m59s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56 Created pod: maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt 8m59s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-6c0c09 Scaled up replica set maas-api-e2e-worker-single-main-6c0c09-57df7b6c56 from 0 to 1 8m58s Normal Pulling pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 8m58s Normal AddedInterface pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Add eth0 [10.133.1.205/23] from ovn-kubernetes 8m57s Normal Created pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Container created 8m57s Normal Pulled pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 414ms (414ms including waiting). Image size: 194510193 bytes. 8m57s Normal Started pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Container started 8m19s Normal AddedInterface pod/maas-api-revoke-sub-6a85919a-zkgkq Add eth0 [10.132.0.190/23] from ovn-kubernetes 8m19s Normal SuccessfulCreate job/maas-api-revoke-sub-6a85919a Created pod: maas-api-revoke-sub-6a85919a-zkgkq 8m18s Normal Created pod/maas-api-revoke-sub-6a85919a-zkgkq Container created 8m18s Normal Started pod/maas-api-revoke-sub-6a85919a-zkgkq Container started 8m18s Normal Pulled pod/maas-api-revoke-sub-6a85919a-zkgkq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m15s Normal Completed job/maas-api-revoke-sub-6a85919a Job completed 8m8s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-6c0c09 Created pod: maas-api-revoke-keys-e2e-worker-single-main-6c0c09-2qqzl 8m7s Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-6c0c09-2qqzl Add eth0 [10.132.0.191/23] from ovn-kubernetes 8m7s Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-6c0c09-2qqzl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m7s Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-6c0c09-2qqzl Container created 8m7s Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-6c0c09-2qqzl Container started 8m4s Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-6c0c09 Job completed 7m56s Normal Killing pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Stopping container maas-api 7m56s Warning Unhealthy pod/maas-api-e2e-worker-single-main-6c0c09-57df7b6c56-k2dqt Readiness probe failed: Get "https://10.133.1.205:8443/health": dial tcp 10.133.1.205:8443: connect: connection refused 7m47s Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-qd9fz 7m46s Normal Created pod/maas-api-revoke-sub-3d4156f1-qd9fz Container created 7m46s Normal Started pod/maas-api-revoke-sub-3d4156f1-qd9fz Container started 7m46s Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-qd9fz Add eth0 [10.133.1.207/23] from ovn-kubernetes 7m46s Normal Pulled pod/maas-api-revoke-sub-3d4156f1-qd9fz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 7m43s Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 5m59s Normal SuccessfulCreate job/maas-api-revoke-sub-d576e68b Created pod: maas-api-revoke-sub-d576e68b-p985h 5m58s Normal Pulled pod/maas-api-revoke-sub-d576e68b-p985h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 5m58s Normal Started pod/maas-api-revoke-sub-d576e68b-p985h Container started 5m58s Normal AddedInterface pod/maas-api-revoke-sub-d576e68b-p985h Add eth0 [10.133.1.208/23] from ovn-kubernetes 5m58s Normal Created pod/maas-api-revoke-sub-d576e68b-p985h Container created 5m55s Normal Completed job/maas-api-revoke-sub-d576e68b Job completed 5m42s Normal AddedInterface pod/maas-api-revoke-sub-d2bc93bc-4lcmj Add eth0 [10.133.1.209/23] from ovn-kubernetes 5m42s Normal SuccessfulCreate job/maas-api-revoke-sub-d2bc93bc Created pod: maas-api-revoke-sub-d2bc93bc-4lcmj 5m42s Normal Pulled pod/maas-api-revoke-sub-d2bc93bc-4lcmj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 5m41s Normal Started pod/maas-api-revoke-sub-d2bc93bc-4lcmj Container started 5m41s Normal Created pod/maas-api-revoke-sub-d2bc93bc-4lcmj Container created 5m38s Normal Completed job/maas-api-revoke-sub-d2bc93bc Job completed 5m26s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96 Created pod: maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f 5m26s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-ee1c63 Scaled up replica set maas-api-e2e-worker-single-main-ee1c63-fd6df5d96 from 0 to 1 5m25s Normal Pulling pod/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 5m25s Normal AddedInterface pod/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f Add eth0 [10.133.1.210/23] from ovn-kubernetes 5m24s Normal Created pod/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f Container created 5m24s Normal Pulled pod/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 538ms (538ms including waiting). Image size: 194510193 bytes. 5m24s Normal Started pod/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f Container started 4m50s Normal SuccessfulCreate job/maas-api-revoke-sub-88c0edca Created pod: maas-api-revoke-sub-88c0edca-4svrf 4m50s Normal AddedInterface pod/maas-api-revoke-sub-88c0edca-4svrf Add eth0 [10.132.0.193/23] from ovn-kubernetes 4m50s Normal Pulled pod/maas-api-revoke-sub-88c0edca-4svrf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m49s Normal Started pod/maas-api-revoke-sub-88c0edca-4svrf Container started 4m49s Normal Created pod/maas-api-revoke-sub-88c0edca-4svrf Container created 4m46s Normal Completed job/maas-api-revoke-sub-88c0edca Job completed 4m39s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-ee1c63 Created pod: maas-api-revoke-keys-e2e-worker-single-main-ee1c63-g7zn9 4m39s Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-ee1c63-g7zn9 Add eth0 [10.132.0.194/23] from ovn-kubernetes 4m39s Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-ee1c63-g7zn9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m38s Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-ee1c63-g7zn9 Container started 4m38s Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-ee1c63-g7zn9 Container created 4m36s Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-ee1c63 Job completed 4m26s Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-single-main-ee1c63 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-single-main-ee1c63: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-single-main-ee1c63": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-single-main-ee1c63, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7e888378-f711-463a-b165-a6abd23f67f5, UID in object meta: 4m26s Normal Killing pod/maas-api-e2e-worker-single-main-ee1c63-fd6df5d96-bv76f Stopping container maas-api 3m41s Normal SuccessfulCreate job/maas-api-revoke-sub-452b6d7b Created pod: maas-api-revoke-sub-452b6d7b-nzv9h 3m40s Normal Pulled pod/maas-api-revoke-sub-452b6d7b-nzv9h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m40s Normal Started pod/maas-api-revoke-sub-452b6d7b-nzv9h Container started 3m40s Normal AddedInterface pod/maas-api-revoke-sub-452b6d7b-nzv9h Add eth0 [10.133.1.212/23] from ovn-kubernetes 3m40s Normal Created pod/maas-api-revoke-sub-452b6d7b-nzv9h Container created 3m36s Normal Completed job/maas-api-revoke-sub-452b6d7b Job completed 3m23s Normal AddedInterface pod/maas-api-revoke-sub-3e31a506-b2wgz Add eth0 [10.133.1.213/23] from ovn-kubernetes 3m23s Normal SuccessfulCreate job/maas-api-revoke-sub-3e31a506 Created pod: maas-api-revoke-sub-3e31a506-b2wgz 3m22s Normal Created pod/maas-api-revoke-sub-3e31a506-b2wgz Container created 3m22s Normal Started pod/maas-api-revoke-sub-3e31a506-b2wgz Container started 3m22s Normal Pulled pod/maas-api-revoke-sub-3e31a506-b2wgz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m19s Normal Completed job/maas-api-revoke-sub-3e31a506 Job completed 3m Normal SuccessfulCreate job/maas-api-revoke-sub-0c3684cc Created pod: maas-api-revoke-sub-0c3684cc-fxtdm 2m59s Normal Started pod/maas-api-revoke-sub-0c3684cc-fxtdm Container started 2m59s Normal Created pod/maas-api-revoke-sub-0c3684cc-fxtdm Container created 2m59s Normal Pulled pod/maas-api-revoke-sub-0c3684cc-fxtdm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m59s Normal AddedInterface pod/maas-api-revoke-sub-0c3684cc-fxtdm Add eth0 [10.133.1.214/23] from ovn-kubernetes 2m56s Normal Completed job/maas-api-revoke-sub-0c3684cc Job completed 2m48s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-595cc648c from 0 to 1 2m48s Normal SuccessfulCreate replicaset/maas-api-5c48877c75 Created pod: maas-api-5c48877c75-2pbs6 2m48s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-5c48877c75 from 1 to 2 2m48s Normal SuccessfulCreate replicaset/maas-api-595cc648c Created pod: maas-api-595cc648c-f87h8 2m47s Normal Pulling pod/maas-api-595cc648c-f87h8 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 2m47s Normal AddedInterface pod/maas-api-595cc648c-f87h8 Add eth0 [10.134.0.204/23] from ovn-kubernetes 2m47s Normal AddedInterface pod/maas-api-5c48877c75-2pbs6 Add eth0 [10.133.1.215/23] from ovn-kubernetes 2m47s Normal Pulled pod/maas-api-595cc648c-f87h8 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 392ms (392ms including waiting). Image size: 194510193 bytes. 2m47s Normal Pulling pod/maas-api-5c48877c75-2pbs6 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 2m47s Normal Created pod/maas-api-595cc648c-f87h8 Container created 2m47s Normal Pulled pod/maas-api-5c48877c75-2pbs6 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 450ms (450ms including waiting). Image size: 194510193 bytes. 2m47s Normal Started pod/maas-api-595cc648c-f87h8 Container started 2m46s Normal Created pod/maas-api-5c48877c75-2pbs6 Container created 2m46s Normal Started pod/maas-api-5c48877c75-2pbs6 Container started 2m40s Normal Killing pod/maas-api-5c48877c75-2pbs6 Stopping container maas-api 2m40s Normal SuccessfulCreate replicaset/maas-api-595cc648c Created pod: maas-api-595cc648c-gmtg7 2m40s Normal SuccessfulDelete replicaset/maas-api-5c48877c75 Deleted pod: maas-api-5c48877c75-2pbs6 2m40s Normal AddedInterface pod/maas-api-595cc648c-gmtg7 Add eth0 [10.133.1.216/23] from ovn-kubernetes 2m40s Normal Pulling pod/maas-api-595cc648c-gmtg7 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 2m40s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-595cc648c from 1 to 2 2m40s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-5c48877c75 from 2 to 1 2m39s Normal Pulled pod/maas-api-595cc648c-gmtg7 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 298ms (298ms including waiting). Image size: 194510193 bytes. 2m39s Normal Started pod/maas-api-595cc648c-gmtg7 Container started 2m39s Normal Created pod/maas-api-595cc648c-gmtg7 Container created 2m31s Normal SuccessfulDelete replicaset/maas-api-5c48877c75 Deleted pod: maas-api-5c48877c75-skq9m 2m31s Normal Killing pod/maas-api-5c48877c75-skq9m Stopping container maas-api 2m31s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-5c48877c75 from 1 to 0 2m24s Normal Pulled pod/maas-api-revoke-sub-f03629db-mmvdq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m24s Normal SuccessfulCreate job/maas-api-revoke-sub-f03629db Created pod: maas-api-revoke-sub-f03629db-mmvdq 2m24s Normal AddedInterface pod/maas-api-revoke-sub-f03629db-mmvdq Add eth0 [10.132.0.196/23] from ovn-kubernetes 2m23s Normal Started pod/maas-api-revoke-sub-f03629db-mmvdq Container started 2m23s Normal Created pod/maas-api-revoke-sub-f03629db-mmvdq Container created 2m20s Normal Completed job/maas-api-revoke-sub-f03629db Job completed 2m12s Normal SuccessfulCreate job/maas-api-revoke-sub-0165d7d2 Created pod: maas-api-revoke-sub-0165d7d2-ssltj 2m11s Normal Created pod/maas-api-revoke-sub-0165d7d2-ssltj Container created 2m11s Normal Started pod/maas-api-revoke-sub-0165d7d2-ssltj Container started 2m11s Normal AddedInterface pod/maas-api-revoke-sub-0165d7d2-ssltj Add eth0 [10.132.0.197/23] from ovn-kubernetes 2m11s Normal Pulled pod/maas-api-revoke-sub-0165d7d2-ssltj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m8s Normal Completed job/maas-api-revoke-sub-0165d7d2 Job completed 2m1s Normal SuccessfulCreate job/maas-api-revoke-sub-6b19338f Created pod: maas-api-revoke-sub-6b19338f-wttpl 2m Normal AddedInterface pod/maas-api-revoke-sub-6b19338f-wttpl Add eth0 [10.132.0.198/23] from ovn-kubernetes 2m Normal Created pod/maas-api-revoke-sub-6b19338f-wttpl Container created 2m Normal Started pod/maas-api-revoke-sub-6b19338f-wttpl Container started 2m Normal Pulled pod/maas-api-revoke-sub-6b19338f-wttpl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 117s Normal Completed job/maas-api-revoke-sub-6b19338f Job completed