=== events in odh-ai-gateway-infra (2026-10-30T14:00:17Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 52m Normal Scheduled pod/maas-api-revoke-sub-73bcaeed-tzwn7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-73bcaeed-tzwn7 to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-aff624f9-44trc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-aff624f9-44trc to ip-10-0-137-6.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx to ip-10-0-137-6.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-8aa9e2f8-rsl6g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8aa9e2f8-rsl6g to ip-10-0-133-61.ec2.internal 17s Normal Scheduled pod/maas-api-key-cleanup-29889480-dwqfh Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29889480-dwqfh to ip-10-0-138-103.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-8fb64431-k2f2c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-8fb64431-k2f2c to ip-10-0-133-61.ec2.internal 2m45s Normal Scheduled pod/maas-api-595cc648c-w57x7 Successfully assigned odh-ai-gateway-infra/maas-api-595cc648c-w57x7 to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-905c6e55-p4pmm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-905c6e55-p4pmm to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-key-cleanup-29889465-r87lk Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29889465-r87lk to ip-10-0-137-6.ec2.internal 60m Normal Scheduled pod/postgres-7cdbf6dc44-qr9vn Successfully assigned odh-ai-gateway-infra/postgres-7cdbf6dc44-qr9vn to ip-10-0-138-103.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-sub-91e57fb3-94t58 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-91e57fb3-94t58 to ip-10-0-133-61.ec2.internal 45m Warning FailedScheduling pod/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt to ip-10-0-133-61.ec2.internal 59m Normal Scheduled pod/maas-api-5c48877c75-4zm8v Successfully assigned odh-ai-gateway-infra/maas-api-5c48877c75-4zm8v to ip-10-0-138-103.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-29889450-t4jnj Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29889450-t4jnj to ip-10-0-133-61.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-884fa692-9k955 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-884fa692-9k955 to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn to ip-10-0-138-103.ec2.internal 45m Warning FailedScheduling pod/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-29889435-dlkxh Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-29889435-dlkxh to ip-10-0-138-103.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb to ip-10-0-138-103.ec2.internal 2m53s Normal Scheduled pod/maas-api-5c48877c75-spd87 Successfully assigned odh-ai-gateway-infra/maas-api-5c48877c75-spd87 to ip-10-0-137-6.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf to ip-10-0-138-103.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-ff7dcd08-llg72 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ff7dcd08-llg72 to ip-10-0-133-61.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw to ip-10-0-137-6.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-99802cce-r8d8r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-99802cce-r8d8r to ip-10-0-133-61.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr to ip-10-0-133-61.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-857e706d-sdzv6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-857e706d-sdzv6 to ip-10-0-133-61.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 to ip-10-0-137-6.ec2.internal 13m Normal Scheduled pod/maas-api-revoke-sub-85237e45-q8tpb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-q8tpb to ip-10-0-137-6.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 to ip-10-0-138-103.ec2.internal 19m Normal Scheduled pod/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 to ip-10-0-137-6.ec2.internal 53m Normal Scheduled pod/maas-api-revoke-sub-ff1ab4ee-dn9m6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ff1ab4ee-dn9m6 to ip-10-0-133-61.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 to ip-10-0-133-61.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w4-b29df4-zn94s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b29df4-zn94s to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w5-82796d-lthsc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w5-82796d-lthsc to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9-pb8r8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9-pb8r8 to ip-10-0-133-61.ec2.internal 20m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w2-5a6281-mdj69 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-5a6281-mdj69 to ip-10-0-133-61.ec2.internal 8m20s Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0-v4zm7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0-v4zm7 to ip-10-0-133-61.ec2.internal 4m51s Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-single-main-d61c7a-tnn8f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-single-main-d61c7a-tnn8f to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w0-f07dfe-bbj94 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-f07dfe-bbj94 to ip-10-0-137-6.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w1-52a649-jn2jp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-52a649-jn2jp to ip-10-0-133-61.ec2.internal 50m Normal Scheduled pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd to ip-10-0-133-61.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w2-cb58b8-8pnwt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-cb58b8-8pnwt to ip-10-0-133-61.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w3-d833bd-wb2zc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-d833bd-wb2zc to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5-zmdk4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5-zmdk4 to ip-10-0-133-61.ec2.internal 23m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w4-d7e62b-cqrsk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-d7e62b-cqrsk to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w5-e34fd5-xr5jq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w5-e34fd5-xr5jq to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-worker-w6-ee7d65-vzdrj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-ee7d65-vzdrj to ip-10-0-133-61.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-012bfe7c-zcsm9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-012bfe7c-zcsm9 to ip-10-0-133-61.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn to ip-10-0-138-103.ec2.internal 56m Normal Scheduled pod/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg to ip-10-0-138-103.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w0-6da60a-97mnb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w0-6da60a-97mnb to ip-10-0-133-61.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-9ff3c51a-kndmx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-9ff3c51a-kndmx to ip-10-0-133-61.ec2.internal 5m37s Normal Scheduled pod/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb to ip-10-0-137-6.ec2.internal 44m Normal Scheduled pod/maas-api-revoke-sub-a3d3ba8b-q2sw5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a3d3ba8b-q2sw5 to ip-10-0-137-6.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r to ip-10-0-137-6.ec2.internal 2m18s Normal Scheduled pod/maas-api-revoke-sub-0165d7d2-dzgvv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-dzgvv to ip-10-0-138-103.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-01ae9417-p8zq8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-01ae9417-p8zq8 to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w6-9c6033-2wsjv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w6-9c6033-2wsjv to ip-10-0-133-61.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Warning FailedScheduling pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-83a70454-h7vv6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-83a70454-h7vv6 to ip-10-0-133-61.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-a4aef7d7-h5ssk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-h5ssk to ip-10-0-133-61.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-a75b2a72-gxdpl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-a75b2a72-gxdpl to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-ace0686d-ljqxb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ace0686d-ljqxb to ip-10-0-137-6.ec2.internal 9m12s Normal Scheduled pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp to ip-10-0-137-6.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc-lcmw9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc-lcmw9 to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-027f93be-mjxsj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-027f93be-mjxsj to ip-10-0-133-61.ec2.internal 45m Warning FailedScheduling pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Warning FailedScheduling pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 44m Normal Scheduled pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k to ip-10-0-137-6.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-81f1e5fd-ht4ch Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-81f1e5fd-ht4ch to ip-10-0-133-61.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-7d6ce356-24gfn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-7d6ce356-24gfn to ip-10-0-133-61.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw to ip-10-0-133-61.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-adb85511-ggbgs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-adb85511-ggbgs to ip-10-0-133-61.ec2.internal 29m Normal Scheduled pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 to ip-10-0-133-61.ec2.internal 25m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b-qnlv6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b-qnlv6 to ip-10-0-133-61.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-79805ca9-9f8gj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-9f8gj to ip-10-0-133-61.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-046e1343-ldftn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-ldftn to ip-10-0-133-61.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-07129f75-fdpkr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-07129f75-fdpkr to ip-10-0-133-61.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 to ip-10-0-133-61.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-09a050ff-29fqr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-09a050ff-29fqr to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 to ip-10-0-138-103.ec2.internal 45m Normal Scheduled pod/maas-api-revoke-sub-774b5079-rnk2n Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-774b5079-rnk2n to ip-10-0-137-6.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w3-c47903-rhgrn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-c47903-rhgrn to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b to ip-10-0-133-61.ec2.internal 46m Normal Scheduled pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz to ip-10-0-138-103.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-addee7da-5njc7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-addee7da-5njc7 to ip-10-0-133-61.ec2.internal 44m Normal Scheduled pod/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx to ip-10-0-137-6.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-0a838a82-7ssnd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0a838a82-7ssnd to ip-10-0-133-61.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-ae594979-6dbvl Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-6dbvl to ip-10-0-133-61.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0-544n7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0-544n7 to ip-10-0-133-61.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-aef9da70-g22n9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-aef9da70-g22n9 to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg to ip-10-0-138-103.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp to ip-10-0-138-103.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-6e1ba611-lhppx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6e1ba611-lhppx to ip-10-0-133-61.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-6c746f1a-rw8wk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6c746f1a-rw8wk to ip-10-0-133-61.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l to ip-10-0-138-103.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-0b6092f3-ffr4l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b6092f3-ffr4l to ip-10-0-133-61.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w1-ff4285-6pwfh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w1-ff4285-6pwfh to ip-10-0-133-61.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4-zx7h5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4-zx7h5 to ip-10-0-133-61.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-df6c3661-wg5kt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-df6c3661-wg5kt to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-df6c3661-5tfnb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-df6c3661-5tfnb to ip-10-0-137-6.ec2.internal 45m Normal Scheduled pod/maas-api-revoke-keys-e2e-mt-3778dacd-fqdm6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3778dacd-fqdm6 to ip-10-0-137-6.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-keys-e2e-migrate-7e2137bc-7rp8t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e2137bc-7rp8t to ip-10-0-133-61.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-0b7e8edb-q5xrk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-q5xrk to ip-10-0-133-61.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-0bc60d35-sb2kb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-0bc60d35-sb2kb to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg to ip-10-0-138-103.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk to ip-10-0-138-103.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp to ip-10-0-133-61.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-6b97b9de-kvsj7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b97b9de-kvsj7 to ip-10-0-137-6.ec2.internal 2m8s Normal Scheduled pod/maas-api-revoke-sub-6b19338f-cdjr4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-cdjr4 to ip-10-0-138-103.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-fca422-d62rb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-fca422-d62rb to ip-10-0-133-61.ec2.internal 38m Normal Scheduled pod/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-b2f4fda1-z86bn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b2f4fda1-z86bn to ip-10-0-133-61.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-sub-11d521cb-55x4w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-11d521cb-55x4w to ip-10-0-133-61.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Successfully assigned odh-ai-gateway-infra/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j to ip-10-0-137-6.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-12826b2b-lq4cq Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-12826b2b-lq4cq to ip-10-0-133-61.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-167051bd-vc57w Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-167051bd-vc57w to ip-10-0-133-61.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-e3ebf5-tv8h8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3ebf5-tv8h8 to ip-10-0-133-61.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-187291ac-hk42z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-187291ac-hk42z to ip-10-0-133-61.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-c54f0f-4l8q6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c54f0f-4l8q6 to ip-10-0-133-61.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-8ee35e-7jhwc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-8ee35e-7jhwc to ip-10-0-133-61.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-1b28ef90-558g5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1b28ef90-558g5 to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-1c2c6ae4-4ktfd Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1c2c6ae4-4ktfd to ip-10-0-133-61.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-1d25db49-xrw2t Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1d25db49-xrw2t to ip-10-0-137-6.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-30c004-mgxjc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30c004-mgxjc to ip-10-0-133-61.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 to ip-10-0-137-6.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-1f443e7c-5xbkx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-1f443e7c-5xbkx to ip-10-0-133-61.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-20713d97-v5dxz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-20713d97-v5dxz to ip-10-0-133-61.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-b-2b254d-lrp84 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2b254d-lrp84 to ip-10-0-133-61.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-21460530-c5v8z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-21460530-c5v8z to ip-10-0-137-6.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-cf3c79-l9x4v Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cf3c79-l9x4v to ip-10-0-133-61.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-b34582ea-srgl7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b34582ea-srgl7 to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-b77dbc3d-jj26p Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-b77dbc3d-jj26p to ip-10-0-133-61.ec2.internal 27m Normal Scheduled pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm to ip-10-0-137-6.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 to ip-10-0-137-6.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-63da8efd-drpx9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-63da8efd-drpx9 to ip-10-0-133-61.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-63997418-gz4zg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-63997418-gz4zg to ip-10-0-133-61.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-b4fb25-7mxkj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4fb25-7mxkj to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-23bf79b7-9d2p7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-23bf79b7-9d2p7 to ip-10-0-137-6.ec2.internal 36m Normal Scheduled pod/maas-api-revoke-sub-240e9cfd-tcw8l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-240e9cfd-tcw8l to ip-10-0-133-61.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-a8d3b8-nvmfk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a8d3b8-nvmfk to ip-10-0-133-61.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-275ab4bf-vnzdk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-275ab4bf-vnzdk to ip-10-0-133-61.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm to ip-10-0-138-103.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-280238be-w76vf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-280238be-w76vf to ip-10-0-137-6.ec2.internal 17m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-78dc89-95gtz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-78dc89-95gtz to ip-10-0-133-61.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-28f44fd7-28mq7 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-28f44fd7-28mq7 to ip-10-0-133-61.ec2.internal 19m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-428a0e-m9f5r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-428a0e-m9f5r to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-29ceb91f-lw2hx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-29ceb91f-lw2hx to ip-10-0-137-6.ec2.internal 21m Normal Scheduled pod/maas-api-revoke-keys-e2e-ipp-a-082748-mzpq8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-082748-mzpq8 to ip-10-0-133-61.ec2.internal 35m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-ddb271-f5gd8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ddb271-f5gd8 to ip-10-0-133-61.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-8467ed-gr9m4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8467ed-gr9m4 to ip-10-0-133-61.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst to ip-10-0-138-103.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-5dd8cc-29kf8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5dd8cc-29kf8 to ip-10-0-133-61.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-5c7ba3-md8hb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5c7ba3-md8hb to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp to ip-10-0-137-6.ec2.internal 2m52s Normal Scheduled pod/maas-api-595cc648c-4jkwp Successfully assigned odh-ai-gateway-infra/maas-api-595cc648c-4jkwp to ip-10-0-137-6.ec2.internal 44m Normal Scheduled pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp to ip-10-0-138-103.ec2.internal 44m Warning FailedScheduling pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 45m Warning FailedScheduling pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp 0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod. 30m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-376c89-hj946 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-376c89-hj946 to ip-10-0-133-61.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-b-09e4c0-fxzmx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-09e4c0-fxzmx to ip-10-0-133-61.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk to ip-10-0-133-61.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-b5a369-t88s9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b5a369-t88s9 to ip-10-0-133-61.ec2.internal 35m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-77254d-r5xtk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-77254d-r5xtk to ip-10-0-133-61.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-47628d-r7v9b Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-47628d-r7v9b to ip-10-0-133-61.ec2.internal 31m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-4651e8-9j4n2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4651e8-9j4n2 to ip-10-0-133-61.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-31721c-kcb4z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-31721c-kcb4z to ip-10-0-137-6.ec2.internal 33m Normal Scheduled pod/maas-api-revoke-keys-e2e-inf-a-0ad384-mp6rb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ad384-mp6rb to ip-10-0-133-61.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-keys-e2e-derive-45c4d25f-v876f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-45c4d25f-v876f to ip-10-0-133-61.ec2.internal 41m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-84942a-ttm66 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84942a-ttm66 to ip-10-0-133-61.ec2.internal 42m Normal Scheduled pod/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 to ip-10-0-137-6.ec2.internal 43m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-6b0881-82hrm Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6b0881-82hrm to ip-10-0-133-61.ec2.internal 41m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-4644a1-cxndr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4644a1-cxndr to ip-10-0-133-61.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-b-2daeae-kb8p9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-2daeae-kb8p9 to ip-10-0-133-61.ec2.internal 44m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-fafb3f-cf6wb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-fafb3f-cf6wb to ip-10-0-137-6.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-9fcb69-scjck Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9fcb69-scjck to ip-10-0-133-61.ec2.internal 42m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-8af0fe-47bdr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8af0fe-47bdr to ip-10-0-133-61.ec2.internal 43m Normal Scheduled pod/maas-api-revoke-keys-e2e-api-a-659d72-8glwc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-659d72-8glwc to ip-10-0-137-6.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-b31c2926-5qpgc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b31c2926-5qpgc to ip-10-0-133-61.ec2.internal 41m Normal Scheduled pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd to ip-10-0-138-103.ec2.internal 48m Normal Scheduled pod/maas-api-revoke-keys-e2e-ait-911fe1d6-b8n2r Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-911fe1d6-b8n2r to ip-10-0-133-61.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-6192dbad-6mrgv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-6192dbad-6mrgv to ip-10-0-137-6.ec2.internal 31m Normal Scheduled pod/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb to ip-10-0-133-61.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-2c097f0d-8sm6v Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2c097f0d-8sm6v to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 to ip-10-0-133-61.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-5dea114b-dd2s9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5dea114b-dd2s9 to ip-10-0-133-61.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 to ip-10-0-133-61.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-5cf4d32e-vvmq5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5cf4d32e-vvmq5 to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 to ip-10-0-137-6.ec2.internal 38m Normal Scheduled pod/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g to ip-10-0-133-61.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-2e1f5b5f-5vjzz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-5vjzz to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-2f86e315-sxk99 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-2f86e315-sxk99 to ip-10-0-137-6.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-30230832-pp4fz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-30230832-pp4fz to ip-10-0-133-61.ec2.internal 55m Normal Scheduled pod/maas-api-revoke-sub-3037e700-69drw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3037e700-69drw to ip-10-0-133-61.ec2.internal 32m Normal Scheduled pod/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc to ip-10-0-137-6.ec2.internal 47m Normal Scheduled pod/maas-api-revoke-sub-5b39a67e-6swfj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5b39a67e-6swfj to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 to ip-10-0-138-103.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn to ip-10-0-137-6.ec2.internal 15m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln to ip-10-0-133-61.ec2.internal 37m Normal Scheduled pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq to ip-10-0-133-61.ec2.internal 43m Normal Scheduled pod/maas-api-revoke-sub-5989e3ed-224rs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5989e3ed-224rs to ip-10-0-133-61.ec2.internal 18m Normal Scheduled pod/maas-api-revoke-sub-56eadae9-mw8xx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-56eadae9-mw8xx to ip-10-0-133-61.ec2.internal 48m Normal Scheduled pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj to ip-10-0-137-6.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-306f377f-5pqdt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-306f377f-5pqdt to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh to ip-10-0-138-103.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-bb60638f-4qm26 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bb60638f-4qm26 to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t to ip-10-0-137-6.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv to ip-10-0-137-6.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-310a6533-tw57s Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-310a6533-tw57s to ip-10-0-133-61.ec2.internal 37m Normal Scheduled pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk to ip-10-0-137-6.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-54ef410a-xg7w2 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-54ef410a-xg7w2 to ip-10-0-133-61.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb to ip-10-0-137-6.ec2.internal 32m Normal Scheduled pod/maas-api-revoke-sub-bf6e4f8f-m65bs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-bf6e4f8f-m65bs to ip-10-0-133-61.ec2.internal 29m Normal Scheduled pod/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk Successfully assigned odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk to ip-10-0-138-103.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-5350dd6a-69ckg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-5350dd6a-69ckg to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-50ee1507-fjszz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-50ee1507-fjszz to ip-10-0-133-61.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-338efa68-twqv4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-338efa68-twqv4 to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-revoke-sub-33cbda8b-wv8z5 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-33cbda8b-wv8z5 to ip-10-0-133-61.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v to ip-10-0-137-6.ec2.internal 28m Normal Scheduled pod/maas-api-revoke-sub-33efb373-j9whk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-33efb373-j9whk to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr to ip-10-0-137-6.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-3466c89d-w4565 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3466c89d-w4565 to ip-10-0-133-61.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-50d7e814-wcppn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-50d7e814-wcppn to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd to ip-10-0-137-6.ec2.internal 49m Normal Scheduled pod/maas-api-revoke-sub-4f5dace6-dms2f Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4f5dace6-dms2f to ip-10-0-133-61.ec2.internal 39m Normal Scheduled pod/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d to ip-10-0-137-6.ec2.internal 43m Normal Scheduled pod/maas-api-e2e-mt-df6c3661-6695779d4-hg824 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-df6c3661-6695779d4-hg824 to ip-10-0-138-103.ec2.internal 29m Normal Scheduled pod/maas-api-revoke-sub-366b8d90-8npfn Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-366b8d90-8npfn to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf to ip-10-0-137-6.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-3a334383-z8p8z Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3a334383-z8p8z to ip-10-0-133-61.ec2.internal 5m2s Normal Scheduled pod/maas-api-revoke-sub-4ebe2e92-tj49n Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4ebe2e92-tj49n to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 to ip-10-0-133-61.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-4d776433-l25qt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4d776433-l25qt to ip-10-0-133-61.ec2.internal 40m Normal Scheduled pod/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq Successfully assigned odh-ai-gateway-infra/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq to ip-10-0-133-61.ec2.internal 47m Normal Scheduled pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz Successfully assigned odh-ai-gateway-infra/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz to ip-10-0-138-103.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-4ac3bc12-jlntx Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4ac3bc12-jlntx to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb to ip-10-0-137-6.ec2.internal 9m39s Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-65lbb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-65lbb to ip-10-0-137-6.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-br444 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-br444 to ip-10-0-137-6.ec2.internal 10m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-df4xz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-df4xz to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 to ip-10-0-138-103.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n to ip-10-0-137-6.ec2.internal 8m Normal Scheduled pod/maas-api-revoke-sub-3d4156f1-ps4mr Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-ps4mr to ip-10-0-137-6.ec2.internal 26m Normal Scheduled pod/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j to ip-10-0-138-103.ec2.internal 49m Normal Scheduled pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Successfully assigned odh-ai-gateway-infra/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f to ip-10-0-137-6.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-4a2ff16c-72nqs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4a2ff16c-72nqs to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-fee525a9-ksbdv Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fee525a9-ksbdv to ip-10-0-133-61.ec2.internal 8m31s Normal Scheduled pod/maas-api-revoke-sub-fc5ec89e-7mfmj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fc5ec89e-7mfmj to ip-10-0-133-61.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-3d89fa0d-tpp7g Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3d89fa0d-tpp7g to ip-10-0-133-61.ec2.internal 3m46s Normal Scheduled pod/maas-api-revoke-sub-452b6d7b-fvl2n Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-fvl2n to ip-10-0-137-6.ec2.internal 15m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 to ip-10-0-137-6.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-40bd9b0b-54kfk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-40bd9b0b-54kfk to ip-10-0-137-6.ec2.internal 24m Normal Scheduled pod/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh to ip-10-0-133-61.ec2.internal 13m Normal Scheduled pod/maas-api-revoke-sub-c1e271a9-l5b9d Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-l5b9d to ip-10-0-137-6.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-c6b8d54f-cqd6h Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c6b8d54f-cqd6h to ip-10-0-133-61.ec2.internal 41m Normal Scheduled pod/maas-api-revoke-sub-fb670967-ng6z6 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fb670967-ng6z6 to ip-10-0-133-61.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-fa3bb89b-hsh7l Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-fa3bb89b-hsh7l to ip-10-0-133-61.ec2.internal 3m5s Normal Scheduled pod/maas-api-revoke-sub-f929de75-j7xrt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f929de75-j7xrt to ip-10-0-137-6.ec2.internal 21m Normal Scheduled pod/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 to ip-10-0-137-6.ec2.internal 14m Normal Scheduled pod/maas-api-revoke-sub-d9fa5c55-sndgt Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d9fa5c55-sndgt to ip-10-0-137-6.ec2.internal 16m Normal Scheduled pod/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9-g4j9j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9-g4j9j to ip-10-0-133-61.ec2.internal 22m Normal Scheduled pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg to ip-10-0-137-6.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-c8ebfa0e-4wzxj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c8ebfa0e-4wzxj to ip-10-0-133-61.ec2.internal 34m Normal Scheduled pod/maas-api-revoke-sub-c90a6f86-hj4rj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-c90a6f86-hj4rj to ip-10-0-133-61.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 to ip-10-0-137-6.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-f8234e9d-qxpdh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f8234e9d-qxpdh to ip-10-0-137-6.ec2.internal 24m Normal Scheduled pod/maas-api-revoke-sub-f33aa610-q9jvg Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f33aa610-q9jvg to ip-10-0-133-61.ec2.internal 20m Normal Scheduled pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d to ip-10-0-137-6.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z to ip-10-0-133-61.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-dbd8b596-j22lj Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-dbd8b596-j22lj to ip-10-0-137-6.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-4031218c-nm46n Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-4031218c-nm46n to ip-10-0-133-61.ec2.internal 23m Normal Scheduled pod/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 to ip-10-0-137-6.ec2.internal 26m Normal Scheduled pod/maas-api-revoke-sub-cbfd24a8-ft7vw Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-cbfd24a8-ft7vw to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-d0f26a78-27pzs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d0f26a78-27pzs to ip-10-0-133-61.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-f2382e43-zj2lf Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f2382e43-zj2lf to ip-10-0-133-61.ec2.internal 2m29s Normal Scheduled pod/maas-api-revoke-sub-f03629db-sqs7j Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-sqs7j to ip-10-0-138-103.ec2.internal 5m55s Normal Scheduled pod/maas-api-revoke-sub-d2bc93bc-58w2x Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-58w2x to ip-10-0-137-6.ec2.internal 11m Normal Scheduled pod/maas-api-revoke-sub-d3fba056-7jzlb Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-7jzlb to ip-10-0-133-61.ec2.internal 21m Normal Scheduled pod/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks to ip-10-0-137-6.ec2.internal 52m Normal Scheduled pod/maas-api-revoke-sub-d47a50f0-mfjgk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d47a50f0-mfjgk to ip-10-0-133-61.ec2.internal 24m Normal Scheduled pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w to ip-10-0-133-61.ec2.internal 6m11s Normal Scheduled pod/maas-api-revoke-sub-d576e68b-k2ft9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-k2ft9 to ip-10-0-137-6.ec2.internal 51m Normal Scheduled pod/maas-api-revoke-sub-e0a0264e-kjmvk Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e0a0264e-kjmvk to ip-10-0-133-61.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-eeaa75ec-7h9r8 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-eeaa75ec-7h9r8 to ip-10-0-133-61.ec2.internal 20m Normal Scheduled pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr to ip-10-0-137-6.ec2.internal 3m25s Normal Scheduled pod/maas-api-revoke-sub-3e31a506-mx6gc Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-mx6gc to ip-10-0-137-6.ec2.internal 50m Normal Scheduled pod/maas-api-revoke-sub-3e785762-kxk2c Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3e785762-kxk2c to ip-10-0-133-61.ec2.internal 30m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 to ip-10-0-137-6.ec2.internal 45m Normal Scheduled pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn Successfully assigned odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn to ip-10-0-137-6.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-3feedf6e-fn79k Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-3feedf6e-fn79k to ip-10-0-133-61.ec2.internal 36m Normal Scheduled pod/maas-api-revoke-sub-ee526181-gxxh9 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ee526181-gxxh9 to ip-10-0-133-61.ec2.internal 24m Normal Scheduled pod/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz to ip-10-0-137-6.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-edb5ea26-2mxrh Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-edb5ea26-2mxrh to ip-10-0-133-61.ec2.internal 12m Normal Scheduled pod/maas-api-revoke-sub-ec843018-rbhlz Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-rbhlz to ip-10-0-133-61.ec2.internal 15m Normal Scheduled pod/maas-api-revoke-sub-e168c9e7-pcwgs Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e168c9e7-pcwgs to ip-10-0-133-61.ec2.internal 22m Normal Scheduled pod/maas-api-revoke-sub-e38f94b4-zv8t4 Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-e38f94b4-zv8t4 to ip-10-0-133-61.ec2.internal 54m Normal Scheduled pod/maas-api-revoke-sub-ec81d790-rl9dp Successfully assigned odh-ai-gateway-infra/maas-api-revoke-sub-ec81d790-rl9dp to ip-10-0-137-6.ec2.internal 24m Normal Scheduled pod/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj Successfully assigned odh-ai-gateway-infra/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj to ip-10-0-138-103.ec2.internal 60m Normal SuccessfulCreate replicaset/postgres-7cdbf6dc44 Created pod: postgres-7cdbf6dc44-qr9vn 60m Normal ScalingReplicaSet deployment/postgres Scaled up replica set postgres-7cdbf6dc44 from 0 to 1 60m Normal AddedInterface pod/postgres-7cdbf6dc44-qr9vn Add eth0 [10.134.0.25/23] from ovn-kubernetes 60m Normal Pulling pod/postgres-7cdbf6dc44-qr9vn Pulling image "registry.redhat.io/rhel9/postgresql-16:latest" 60m Normal Pulled pod/postgres-7cdbf6dc44-qr9vn Successfully pulled image "registry.redhat.io/rhel9/postgresql-16:latest" in 4.626s (4.626s including waiting). Image size: 403732742 bytes. 60m Normal Created pod/postgres-7cdbf6dc44-qr9vn Container created 60m Normal Started pod/postgres-7cdbf6dc44-qr9vn Container started 59m Normal SuccessfulCreate replicaset/maas-api-5c48877c75 Created pod: maas-api-5c48877c75-4zm8v 59m Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-5c48877c75 from 0 to 1 59m Warning FailedCreate replicaset/maas-api-5c48877c75 Error creating: pods "maas-api-5c48877c75-" is forbidden: error looking up service account odh-ai-gateway-infra/maas-api: serviceaccount "maas-api" not found 59m Normal Pulling pod/maas-api-5c48877c75-4zm8v Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 59m Normal AddedInterface pod/maas-api-5c48877c75-4zm8v Add eth0 [10.134.0.28/23] from ovn-kubernetes 59m Normal Pulled pod/maas-api-5c48877c75-4zm8v Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 1.53s (1.53s including waiting). Image size: 194510193 bytes. 59m Normal Created pod/maas-api-5c48877c75-4zm8v Container created 59m Normal Started pod/maas-api-5c48877c75-4zm8v Container started 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w1-52a649 Scaled up replica set maas-api-e2e-worker-w1-52a649-f4946f6bb from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w1-52a649-f4946f6bb Created pod: maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn 56m Normal Created pod/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn Container created 56m Normal AddedInterface pod/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn Add eth0 [10.134.0.31/23] from ovn-kubernetes 56m Normal Pulling pod/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal Pulled pod/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 309ms (309ms including waiting). Image size: 194510193 bytes. 56m Normal Started pod/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn Container started 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w6-ee7d65 Scaled up replica set maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6 from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6 Created pod: maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf 56m Normal Pulled pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 425ms (425ms including waiting). Image size: 194510193 bytes. 56m Normal Created pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Container created 56m Normal Pulling pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal AddedInterface pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Add eth0 [10.134.0.32/23] from ovn-kubernetes 56m Normal Started pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Container started 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8 Created pod: maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w0-f07dfe Scaled up replica set maas-api-e2e-worker-w0-f07dfe-7bdf6855d8 from 0 to 1 56m Normal AddedInterface pod/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg Add eth0 [10.134.0.33/23] from ovn-kubernetes 56m Normal Pulling pod/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal Pulled pod/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 325ms (325ms including waiting). Image size: 194510193 bytes. 56m Normal Created pod/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg Container created 56m Normal Started pod/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg Container started 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w3-d833bd-5cf45d8d99 Created pod: maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w3-d833bd Scaled up replica set maas-api-e2e-worker-w3-d833bd-5cf45d8d99 from 0 to 1 56m Normal AddedInterface pod/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 Add eth0 [10.133.0.56/23] from ovn-kubernetes 56m Normal Pulling pod/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w2-cb58b8 Scaled up replica set maas-api-e2e-worker-w2-cb58b8-c59c75f88 from 0 to 1 56m Normal Started pod/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 Container started 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w2-cb58b8-c59c75f88 Created pod: maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 56m Normal Created pod/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 Container created 56m Normal Pulled pod/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 2.97s (2.97s including waiting). Image size: 194510193 bytes. 56m Normal Started pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Container started 56m Normal AddedInterface pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Add eth0 [10.134.0.34/23] from ovn-kubernetes 56m Normal Pulling pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal Pulled pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 338ms (338ms including waiting). Image size: 194510193 bytes. 56m Normal Created pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Container created 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w4-d7e62b Scaled up replica set maas-api-e2e-worker-w4-d7e62b-5879646646 from 0 to 1 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w4-d7e62b-5879646646 Created pod: maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr 56m Warning FailedMount pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-worker-w4-d7e62b-serving-cert" not found 56m Normal AddedInterface pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr Add eth0 [10.132.0.67/23] from ovn-kubernetes 56m Normal SuccessfulCreate replicaset/maas-api-e2e-worker-w5-e34fd5-758756996 Created pod: maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw 56m Normal ScalingReplicaSet deployment/maas-api-e2e-worker-w5-e34fd5 Scaled up replica set maas-api-e2e-worker-w5-e34fd5-758756996 from 0 to 1 56m Normal Pulling pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal Pulling pod/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 56m Normal AddedInterface pod/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw Add eth0 [10.133.0.57/23] from ovn-kubernetes 56m Normal Started pod/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw Container started 56m Normal Created pod/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw Container created 56m Normal Pulled pod/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 423ms (424ms including waiting). Image size: 194510193 bytes. 56m Normal Created pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr Container created 56m Normal Pulled pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 4.579s (4.579s including waiting). Image size: 194510193 bytes. 56m Normal Started pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr Container started 55m Normal AddedInterface pod/maas-api-revoke-sub-3037e700-69drw Add eth0 [10.132.0.74/23] from ovn-kubernetes 55m Normal SuccessfulCreate job/maas-api-revoke-sub-3037e700 Created pod: maas-api-revoke-sub-3037e700-69drw 55m Normal Pulling pod/maas-api-revoke-sub-3037e700-69drw Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 55m Normal Created pod/maas-api-revoke-sub-3037e700-69drw Container created 55m Normal Started pod/maas-api-revoke-sub-3037e700-69drw Container started 55m Normal Pulled pod/maas-api-revoke-sub-3037e700-69drw Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 2.465s (2.465s including waiting). Image size: 107195206 bytes. 55m Normal Completed job/maas-api-revoke-sub-3037e700 Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-81f1e5fd Created pod: maas-api-revoke-sub-81f1e5fd-ht4ch 54m Normal SuccessfulCreate job/maas-api-revoke-sub-ec81d790 Created pod: maas-api-revoke-sub-ec81d790-rl9dp 54m Normal Pulled pod/maas-api-revoke-sub-81f1e5fd-ht4ch Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-81f1e5fd-ht4ch Container created 54m Normal AddedInterface pod/maas-api-revoke-sub-ec81d790-rl9dp Add eth0 [10.133.0.62/23] from ovn-kubernetes 54m Normal AddedInterface pod/maas-api-revoke-sub-81f1e5fd-ht4ch Add eth0 [10.132.0.75/23] from ovn-kubernetes 54m Normal Pulling pod/maas-api-revoke-sub-ec81d790-rl9dp Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 54m Normal Started pod/maas-api-revoke-sub-81f1e5fd-ht4ch Container started 54m Normal SuccessfulCreate job/maas-api-revoke-sub-9ff3c51a Created pod: maas-api-revoke-sub-9ff3c51a-kndmx 54m Normal Pulled pod/maas-api-revoke-sub-ec81d790-rl9dp Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 1.966s (1.966s including waiting). Image size: 107195206 bytes. 54m Normal Started pod/maas-api-revoke-sub-ec81d790-rl9dp Container started 54m Normal Created pod/maas-api-revoke-sub-ec81d790-rl9dp Container created 54m Normal Pulled pod/maas-api-revoke-sub-9ff3c51a-kndmx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-9ff3c51a-kndmx Container created 54m Normal Started pod/maas-api-revoke-sub-9ff3c51a-kndmx Container started 54m Normal AddedInterface pod/maas-api-revoke-sub-9ff3c51a-kndmx Add eth0 [10.132.0.76/23] from ovn-kubernetes 54m Normal Completed job/maas-api-revoke-sub-81f1e5fd Job completed 54m Normal Completed job/maas-api-revoke-sub-ec81d790 Job completed 54m Normal Completed job/maas-api-revoke-sub-9ff3c51a Job completed 54m Normal AddedInterface pod/maas-api-revoke-sub-01ae9417-p8zq8 Add eth0 [10.132.0.77/23] from ovn-kubernetes 54m Normal SuccessfulCreate job/maas-api-revoke-sub-01ae9417 Created pod: maas-api-revoke-sub-01ae9417-p8zq8 54m Normal Pulled pod/maas-api-revoke-sub-01ae9417-p8zq8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-01ae9417-p8zq8 Container created 54m Normal Started pod/maas-api-revoke-sub-01ae9417-p8zq8 Container started 54m Normal SuccessfulCreate job/maas-api-revoke-sub-6192dbad Created pod: maas-api-revoke-sub-6192dbad-6mrgv 54m Normal SuccessfulCreate job/maas-api-revoke-sub-5dea114b Created pod: maas-api-revoke-sub-5dea114b-dd2s9 54m Normal AddedInterface pod/maas-api-revoke-sub-6192dbad-6mrgv Add eth0 [10.133.0.63/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-6192dbad-6mrgv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Pulled pod/maas-api-revoke-sub-5dea114b-dd2s9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Completed job/maas-api-revoke-sub-01ae9417 Job completed 54m Normal Created pod/maas-api-revoke-sub-6192dbad-6mrgv Container created 54m Normal AddedInterface pod/maas-api-revoke-sub-5dea114b-dd2s9 Add eth0 [10.132.0.78/23] from ovn-kubernetes 54m Normal Started pod/maas-api-revoke-sub-6192dbad-6mrgv Container started 54m Normal Started pod/maas-api-revoke-sub-5dea114b-dd2s9 Container started 54m Normal Created pod/maas-api-revoke-sub-5dea114b-dd2s9 Container created 54m Normal SuccessfulCreate job/maas-api-revoke-sub-5350dd6a Created pod: maas-api-revoke-sub-5350dd6a-69ckg 54m Normal Created pod/maas-api-revoke-sub-5350dd6a-69ckg Container created 54m Normal AddedInterface pod/maas-api-revoke-sub-5350dd6a-69ckg Add eth0 [10.132.0.79/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-5350dd6a-69ckg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Started pod/maas-api-revoke-sub-5350dd6a-69ckg Container started 54m Normal Pulled pod/maas-api-revoke-sub-dbd8b596-j22lj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal SuccessfulCreate job/maas-api-revoke-sub-dbd8b596 Created pod: maas-api-revoke-sub-dbd8b596-j22lj 54m Normal Completed job/maas-api-revoke-sub-6192dbad Job completed 54m Normal AddedInterface pod/maas-api-revoke-sub-dbd8b596-j22lj Add eth0 [10.133.0.64/23] from ovn-kubernetes 54m Normal Completed job/maas-api-revoke-sub-5dea114b Job completed 54m Normal Started pod/maas-api-revoke-sub-dbd8b596-j22lj Container started 54m Normal SuccessfulCreate job/maas-api-revoke-sub-2c097f0d Created pod: maas-api-revoke-sub-2c097f0d-8sm6v 54m Normal Created pod/maas-api-revoke-sub-dbd8b596-j22lj Container created 54m Normal Pulled pod/maas-api-revoke-sub-2c097f0d-8sm6v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Created pod/maas-api-revoke-sub-2c097f0d-8sm6v Container created 54m Normal Started pod/maas-api-revoke-sub-2c097f0d-8sm6v Container started 54m Normal Completed job/maas-api-revoke-sub-5350dd6a Job completed 54m Normal AddedInterface pod/maas-api-revoke-sub-2c097f0d-8sm6v Add eth0 [10.132.0.80/23] from ovn-kubernetes 54m Normal Completed job/maas-api-revoke-sub-dbd8b596 Job completed 54m Normal Completed job/maas-api-revoke-sub-2c097f0d Job completed 54m Normal AddedInterface pod/maas-api-revoke-sub-addee7da-5njc7 Add eth0 [10.132.0.81/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-addee7da-5njc7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal SuccessfulCreate job/maas-api-revoke-sub-addee7da Created pod: maas-api-revoke-sub-addee7da-5njc7 54m Normal Created pod/maas-api-revoke-sub-addee7da-5njc7 Container created 54m Normal Started pod/maas-api-revoke-sub-addee7da-5njc7 Container started 54m Normal Completed job/maas-api-revoke-sub-addee7da Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-3466c89d Created pod: maas-api-revoke-sub-3466c89d-w4565 54m Normal AddedInterface pod/maas-api-revoke-sub-3466c89d-w4565 Add eth0 [10.132.0.84/23] from ovn-kubernetes 54m Normal SuccessfulCreate job/maas-api-revoke-sub-54ef410a Created pod: maas-api-revoke-sub-54ef410a-xg7w2 54m Normal Pulled pod/maas-api-revoke-sub-54ef410a-xg7w2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-54ef410a-xg7w2 Add eth0 [10.132.0.85/23] from ovn-kubernetes 54m Normal Started pod/maas-api-revoke-sub-3466c89d-w4565 Container started 54m Normal Created pod/maas-api-revoke-sub-3466c89d-w4565 Container created 54m Normal Pulled pod/maas-api-revoke-sub-3466c89d-w4565 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal SuccessfulCreate job/maas-api-revoke-sub-5cf4d32e Created pod: maas-api-revoke-sub-5cf4d32e-vvmq5 54m Normal Started pod/maas-api-revoke-sub-54ef410a-xg7w2 Container started 54m Normal Created pod/maas-api-revoke-sub-54ef410a-xg7w2 Container created 54m Normal Started pod/maas-api-revoke-sub-5cf4d32e-vvmq5 Container started 54m Normal Created pod/maas-api-revoke-sub-5cf4d32e-vvmq5 Container created 54m Normal Pulled pod/maas-api-revoke-sub-5cf4d32e-vvmq5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal AddedInterface pod/maas-api-revoke-sub-5cf4d32e-vvmq5 Add eth0 [10.133.0.67/23] from ovn-kubernetes 54m Normal Completed job/maas-api-revoke-sub-3466c89d Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-3a334383 Created pod: maas-api-revoke-sub-3a334383-z8p8z 54m Normal Created pod/maas-api-revoke-sub-3a334383-z8p8z Container created 54m Normal AddedInterface pod/maas-api-revoke-sub-3a334383-z8p8z Add eth0 [10.132.0.86/23] from ovn-kubernetes 54m Normal Pulled pod/maas-api-revoke-sub-3a334383-z8p8z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Completed job/maas-api-revoke-sub-54ef410a Job completed 54m Normal Started pod/maas-api-revoke-sub-3a334383-z8p8z Container started 54m Normal Completed job/maas-api-revoke-sub-5cf4d32e Job completed 54m Normal Completed job/maas-api-revoke-sub-3a334383 Job completed 54m Normal SuccessfulCreate job/maas-api-revoke-sub-63da8efd Created pod: maas-api-revoke-sub-63da8efd-drpx9 54m Normal Started pod/maas-api-revoke-sub-63da8efd-drpx9 Container started 54m Normal AddedInterface pod/maas-api-revoke-sub-63da8efd-drpx9 Add eth0 [10.132.0.89/23] from ovn-kubernetes 54m Normal Created pod/maas-api-revoke-sub-63da8efd-drpx9 Container created 54m Normal Pulled pod/maas-api-revoke-sub-63da8efd-drpx9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 54m Normal Completed job/maas-api-revoke-sub-63da8efd Job completed 53m Normal SuccessfulCreate job/maas-api-revoke-sub-ff1ab4ee Created pod: maas-api-revoke-sub-ff1ab4ee-dn9m6 53m Normal Created pod/maas-api-revoke-sub-ff1ab4ee-dn9m6 Container created 53m Normal AddedInterface pod/maas-api-revoke-sub-ff1ab4ee-dn9m6 Add eth0 [10.132.0.93/23] from ovn-kubernetes 53m Normal Pulled pod/maas-api-revoke-sub-ff1ab4ee-dn9m6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 53m Normal Started pod/maas-api-revoke-sub-ff1ab4ee-dn9m6 Container started 52m Normal Completed job/maas-api-revoke-sub-ff1ab4ee Job completed 52m Normal Pulled pod/maas-api-revoke-sub-09a050ff-29fqr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-api-revoke-sub-09a050ff-29fqr Add eth0 [10.132.0.94/23] from ovn-kubernetes 52m Normal SuccessfulCreate job/maas-api-revoke-sub-09a050ff Created pod: maas-api-revoke-sub-09a050ff-29fqr 52m Normal Created pod/maas-api-revoke-sub-09a050ff-29fqr Container created 52m Normal Started pod/maas-api-revoke-sub-09a050ff-29fqr Container started 52m Normal Completed job/maas-api-revoke-sub-09a050ff Job completed 52m Normal SuccessfulCreate job/maas-api-revoke-sub-bb60638f Created pod: maas-api-revoke-sub-bb60638f-4qm26 52m Normal Started pod/maas-api-revoke-sub-bb60638f-4qm26 Container started 52m Normal Created pod/maas-api-revoke-sub-bb60638f-4qm26 Container created 52m Normal Pulled pod/maas-api-revoke-sub-bb60638f-4qm26 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-api-revoke-sub-bb60638f-4qm26 Add eth0 [10.132.0.95/23] from ovn-kubernetes 52m Normal SuccessfulCreate job/maas-api-revoke-sub-857e706d Created pod: maas-api-revoke-sub-857e706d-sdzv6 52m Normal AddedInterface pod/maas-api-revoke-sub-857e706d-sdzv6 Add eth0 [10.132.0.96/23] from ovn-kubernetes 52m Normal Created pod/maas-api-revoke-sub-857e706d-sdzv6 Container created 52m Normal Started pod/maas-api-revoke-sub-857e706d-sdzv6 Container started 52m Normal Pulled pod/maas-api-revoke-sub-857e706d-sdzv6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal SuccessfulCreate job/maas-api-revoke-sub-f8234e9d Created pod: maas-api-revoke-sub-f8234e9d-qxpdh 52m Normal AddedInterface pod/maas-api-revoke-sub-f8234e9d-qxpdh Add eth0 [10.133.0.75/23] from ovn-kubernetes 52m Normal SuccessfulCreate job/maas-api-revoke-sub-0a838a82 Created pod: maas-api-revoke-sub-0a838a82-7ssnd 52m Normal Started pod/maas-api-revoke-sub-f8234e9d-qxpdh Container started 52m Normal AddedInterface pod/maas-api-revoke-sub-0a838a82-7ssnd Add eth0 [10.132.0.97/23] from ovn-kubernetes 52m Normal Started pod/maas-api-revoke-sub-0a838a82-7ssnd Container started 52m Normal AddedInterface pod/maas-api-revoke-sub-0bc60d35-sb2kb Add eth0 [10.132.0.98/23] from ovn-kubernetes 52m Normal SuccessfulCreate job/maas-api-revoke-sub-0bc60d35 Created pod: maas-api-revoke-sub-0bc60d35-sb2kb 52m Normal Created pod/maas-api-revoke-sub-0a838a82-7ssnd Container created 52m Normal Pulled pod/maas-api-revoke-sub-0a838a82-7ssnd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Pulled pod/maas-api-revoke-sub-f8234e9d-qxpdh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Completed job/maas-api-revoke-sub-bb60638f Job completed 52m Normal Pulled pod/maas-api-revoke-sub-0bc60d35-sb2kb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Created pod/maas-api-revoke-sub-f8234e9d-qxpdh Container created 52m Normal Started pod/maas-api-revoke-sub-0bc60d35-sb2kb Container started 52m Normal Created pod/maas-api-revoke-sub-0bc60d35-sb2kb Container created 52m Normal Completed job/maas-api-revoke-sub-857e706d Job completed 52m Normal Completed job/maas-api-revoke-sub-0a838a82 Job completed 52m Normal Completed job/maas-api-revoke-sub-f8234e9d Job completed 52m Normal Completed job/maas-api-revoke-sub-0bc60d35 Job completed 52m Normal SuccessfulCreate job/maas-api-revoke-sub-d47a50f0 Created pod: maas-api-revoke-sub-d47a50f0-mfjgk 52m Normal Pulled pod/maas-api-revoke-sub-d47a50f0-mfjgk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-api-revoke-sub-d47a50f0-mfjgk Add eth0 [10.132.0.99/23] from ovn-kubernetes 52m Normal Created pod/maas-api-revoke-sub-d47a50f0-mfjgk Container created 52m Normal Started pod/maas-api-revoke-sub-d47a50f0-mfjgk Container started 52m Normal SuccessfulCreate job/maas-api-revoke-sub-884fa692 Created pod: maas-api-revoke-sub-884fa692-9k955 52m Normal AddedInterface pod/maas-api-revoke-sub-884fa692-9k955 Add eth0 [10.132.0.102/23] from ovn-kubernetes 52m Normal Started pod/maas-api-revoke-sub-884fa692-9k955 Container started 52m Normal Created pod/maas-api-revoke-sub-884fa692-9k955 Container created 52m Normal Pulled pod/maas-api-revoke-sub-884fa692-9k955 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal SuccessfulCreate job/maas-api-revoke-sub-73bcaeed Created pod: maas-api-revoke-sub-73bcaeed-tzwn7 52m Normal Pulled pod/maas-api-revoke-sub-73bcaeed-tzwn7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Created pod/maas-api-revoke-sub-73bcaeed-tzwn7 Container created 52m Normal AddedInterface pod/maas-api-revoke-sub-73bcaeed-tzwn7 Add eth0 [10.132.0.103/23] from ovn-kubernetes 52m Normal Completed job/maas-api-revoke-sub-d47a50f0 Job completed 52m Normal Started pod/maas-api-revoke-sub-73bcaeed-tzwn7 Container started 52m Normal SuccessfulCreate job/maas-api-revoke-sub-21460530 Created pod: maas-api-revoke-sub-21460530-c5v8z 52m Normal Completed job/maas-api-revoke-sub-884fa692 Job completed 52m Normal AddedInterface pod/maas-api-revoke-sub-21460530-c5v8z Add eth0 [10.133.0.78/23] from ovn-kubernetes 52m Normal Pulled pod/maas-api-revoke-sub-21460530-c5v8z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Started pod/maas-api-revoke-sub-21460530-c5v8z Container started 52m Normal Created pod/maas-api-revoke-sub-21460530-c5v8z Container created 52m Normal Completed job/maas-api-revoke-sub-73bcaeed Job completed 52m Normal SuccessfulCreate job/maas-api-revoke-sub-f2382e43 Created pod: maas-api-revoke-sub-f2382e43-zj2lf 52m Normal Completed job/maas-api-revoke-sub-21460530 Job completed 52m Normal Pulled pod/maas-api-revoke-sub-f2382e43-zj2lf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal AddedInterface pod/maas-api-revoke-sub-f2382e43-zj2lf Add eth0 [10.132.0.104/23] from ovn-kubernetes 52m Normal Created pod/maas-api-revoke-sub-f2382e43-zj2lf Container created 52m Normal Started pod/maas-api-revoke-sub-f2382e43-zj2lf Container started 52m Normal Pulled pod/maas-api-revoke-sub-012bfe7c-zcsm9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 52m Normal Completed job/maas-api-revoke-sub-f2382e43 Job completed 52m Normal AddedInterface pod/maas-api-revoke-sub-012bfe7c-zcsm9 Add eth0 [10.132.0.105/23] from ovn-kubernetes 52m Normal SuccessfulCreate job/maas-api-revoke-sub-012bfe7c Created pod: maas-api-revoke-sub-012bfe7c-zcsm9 52m Normal Started pod/maas-api-revoke-sub-012bfe7c-zcsm9 Container started 52m Normal Created pod/maas-api-revoke-sub-012bfe7c-zcsm9 Container created 52m Normal Completed job/maas-api-revoke-sub-012bfe7c Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-83a70454 Created pod: maas-api-revoke-sub-83a70454-h7vv6 51m Normal SuccessfulCreate job/maas-api-revoke-sub-fee525a9 Created pod: maas-api-revoke-sub-fee525a9-ksbdv 51m Normal Pulled pod/maas-api-revoke-sub-fee525a9-ksbdv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-fee525a9-ksbdv Add eth0 [10.132.0.108/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-fee525a9-ksbdv Container created 51m Normal Pulled pod/maas-api-revoke-sub-83a70454-h7vv6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Started pod/maas-api-revoke-sub-fee525a9-ksbdv Container started 51m Normal Started pod/maas-api-revoke-sub-83a70454-h7vv6 Container started 51m Normal AddedInterface pod/maas-api-revoke-sub-83a70454-h7vv6 Add eth0 [10.132.0.109/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-83a70454-h7vv6 Container created 51m Normal Completed job/maas-api-revoke-sub-fee525a9 Job completed 51m Normal Completed job/maas-api-revoke-sub-83a70454 Job completed 51m Normal Pulled pod/maas-api-revoke-sub-905c6e55-p4pmm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-905c6e55-p4pmm Add eth0 [10.132.0.112/23] from ovn-kubernetes 51m Normal SuccessfulCreate job/maas-api-revoke-sub-905c6e55 Created pod: maas-api-revoke-sub-905c6e55-p4pmm 51m Normal SuccessfulCreate job/maas-api-revoke-sub-29ceb91f Created pod: maas-api-revoke-sub-29ceb91f-lw2hx 51m Normal Created pod/maas-api-revoke-sub-905c6e55-p4pmm Container created 51m Normal Started pod/maas-api-revoke-sub-905c6e55-p4pmm Container started 51m Normal Pulled pod/maas-api-revoke-sub-29ceb91f-lw2hx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Started pod/maas-api-revoke-sub-29ceb91f-lw2hx Container started 51m Normal SuccessfulCreate job/maas-api-revoke-sub-027f93be Created pod: maas-api-revoke-sub-027f93be-mjxsj 51m Normal Created pod/maas-api-revoke-sub-29ceb91f-lw2hx Container created 51m Normal AddedInterface pod/maas-api-revoke-sub-29ceb91f-lw2hx Add eth0 [10.133.0.82/23] from ovn-kubernetes 51m Normal Started pod/maas-api-revoke-sub-027f93be-mjxsj Container started 51m Normal Pulled pod/maas-api-revoke-sub-027f93be-mjxsj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-027f93be-mjxsj Add eth0 [10.132.0.113/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-027f93be-mjxsj Container created 51m Normal Completed job/maas-api-revoke-sub-905c6e55 Job completed 51m Normal Completed job/maas-api-revoke-sub-29ceb91f Job completed 51m Normal Completed job/maas-api-revoke-sub-027f93be Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-b77dbc3d Created pod: maas-api-revoke-sub-b77dbc3d-jj26p 51m Normal Started pod/maas-api-revoke-sub-b77dbc3d-jj26p Container started 51m Normal Created pod/maas-api-revoke-sub-b77dbc3d-jj26p Container created 51m Normal AddedInterface pod/maas-api-revoke-sub-b77dbc3d-jj26p Add eth0 [10.132.0.117/23] from ovn-kubernetes 51m Normal SuccessfulCreate job/maas-api-revoke-sub-ace0686d Created pod: maas-api-revoke-sub-ace0686d-ljqxb 51m Normal Pulled pod/maas-api-revoke-sub-b77dbc3d-jj26p Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-ace0686d-ljqxb Add eth0 [10.133.0.88/23] from ovn-kubernetes 51m Normal Created pod/maas-api-revoke-sub-ace0686d-ljqxb Container created 51m Normal Pulled pod/maas-api-revoke-sub-ace0686d-ljqxb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Started pod/maas-api-revoke-sub-ace0686d-ljqxb Container started 51m Normal SuccessfulCreate job/maas-api-revoke-sub-ff7dcd08 Created pod: maas-api-revoke-sub-ff7dcd08-llg72 51m Normal Pulled pod/maas-api-revoke-sub-ff7dcd08-llg72 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-ff7dcd08-llg72 Add eth0 [10.132.0.118/23] from ovn-kubernetes 51m Normal Started pod/maas-api-revoke-sub-ff7dcd08-llg72 Container started 51m Normal Completed job/maas-api-revoke-sub-b77dbc3d Job completed 51m Normal Created pod/maas-api-revoke-sub-ff7dcd08-llg72 Container created 51m Normal Completed job/maas-api-revoke-sub-ace0686d Job completed 51m Normal Completed job/maas-api-revoke-sub-ff7dcd08 Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-3d89fa0d Created pod: maas-api-revoke-sub-3d89fa0d-tpp7g 51m Normal AddedInterface pod/maas-api-revoke-sub-3d89fa0d-tpp7g Add eth0 [10.132.0.119/23] from ovn-kubernetes 51m Normal Pulled pod/maas-api-revoke-sub-3d89fa0d-tpp7g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Created pod/maas-api-revoke-sub-3d89fa0d-tpp7g Container created 51m Normal Started pod/maas-api-revoke-sub-3d89fa0d-tpp7g Container started 51m Normal SuccessfulCreate job/maas-api-revoke-sub-e0a0264e Created pod: maas-api-revoke-sub-e0a0264e-kjmvk 51m Normal Started pod/maas-api-revoke-sub-e0a0264e-kjmvk Container started 51m Normal AddedInterface pod/maas-api-revoke-sub-e0a0264e-kjmvk Add eth0 [10.132.0.120/23] from ovn-kubernetes 51m Normal Completed job/maas-api-revoke-sub-3d89fa0d Job completed 51m Normal Pulled pod/maas-api-revoke-sub-e0a0264e-kjmvk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Created pod/maas-api-revoke-sub-e0a0264e-kjmvk Container created 51m Normal Completed job/maas-api-revoke-sub-e0a0264e Job completed 51m Normal SuccessfulCreate job/maas-api-revoke-sub-50d7e814 Created pod: maas-api-revoke-sub-50d7e814-wcppn 51m Normal Pulled pod/maas-api-revoke-sub-50d7e814-wcppn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal Started pod/maas-api-revoke-sub-50d7e814-wcppn Container started 51m Normal Created pod/maas-api-revoke-sub-50d7e814-wcppn Container created 51m Normal AddedInterface pod/maas-api-revoke-sub-50d7e814-wcppn Add eth0 [10.132.0.121/23] from ovn-kubernetes 51m Normal SuccessfulCreate job/maas-api-revoke-sub-aff624f9 Created pod: maas-api-revoke-sub-aff624f9-44trc 51m Normal Pulled pod/maas-api-revoke-sub-aff624f9-44trc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 51m Normal AddedInterface pod/maas-api-revoke-sub-aff624f9-44trc Add eth0 [10.133.0.90/23] from ovn-kubernetes 51m Normal Started pod/maas-api-revoke-sub-aff624f9-44trc Container started 51m Normal Created pod/maas-api-revoke-sub-aff624f9-44trc Container created 51m Normal Completed job/maas-api-revoke-sub-50d7e814 Job completed 50m Normal Completed job/maas-api-revoke-sub-aff624f9 Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-8aa9e2f8-rsl6g Add eth0 [10.132.0.123/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-8aa9e2f8 Created pod: maas-api-revoke-sub-8aa9e2f8-rsl6g 50m Normal Created pod/maas-api-revoke-sub-8aa9e2f8-rsl6g Container created 50m Normal Started pod/maas-api-revoke-sub-8aa9e2f8-rsl6g Container started 50m Normal Pulled pod/maas-api-revoke-sub-8aa9e2f8-rsl6g Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal SuccessfulCreate job/maas-api-revoke-sub-eeaa75ec Created pod: maas-api-revoke-sub-eeaa75ec-7h9r8 50m Normal Completed job/maas-api-revoke-sub-8aa9e2f8 Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-eeaa75ec-7h9r8 Add eth0 [10.132.0.125/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-eeaa75ec-7h9r8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-eeaa75ec-7h9r8 Container created 50m Normal Started pod/maas-api-revoke-sub-eeaa75ec-7h9r8 Container started 50m Normal SuccessfulCreate job/maas-api-revoke-sub-4031218c Created pod: maas-api-revoke-sub-4031218c-nm46n 50m Normal Started pod/maas-api-revoke-sub-4031218c-nm46n Container started 50m Normal Created pod/maas-api-revoke-sub-4031218c-nm46n Container created 50m Normal Pulled pod/maas-api-revoke-sub-4031218c-nm46n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-4031218c-nm46n Add eth0 [10.132.0.126/23] from ovn-kubernetes 50m Normal Completed job/maas-api-revoke-sub-eeaa75ec Job completed 50m Normal Completed job/maas-api-revoke-sub-4031218c Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-4a2ff16c Created pod: maas-api-revoke-sub-4a2ff16c-72nqs 50m Normal Pulled pod/maas-api-revoke-sub-4a2ff16c-72nqs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-4a2ff16c-72nqs Add eth0 [10.132.0.127/23] from ovn-kubernetes 50m Normal Started pod/maas-api-revoke-sub-4a2ff16c-72nqs Container started 50m Normal Created pod/maas-api-revoke-sub-4a2ff16c-72nqs Container created 50m Normal SuccessfulCreate job/maas-api-revoke-sub-4d776433 Created pod: maas-api-revoke-sub-4d776433-l25qt 50m Normal Started pod/maas-api-revoke-sub-4d776433-l25qt Container started 50m Normal Created pod/maas-api-revoke-sub-4d776433-l25qt Container created 50m Normal Pulled pod/maas-api-revoke-sub-4d776433-l25qt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-4d776433-l25qt Add eth0 [10.132.0.128/23] from ovn-kubernetes 50m Normal Completed job/maas-api-revoke-sub-4a2ff16c Job completed 50m Normal Completed job/maas-api-revoke-sub-4d776433 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-310a6533 Created pod: maas-api-revoke-sub-310a6533-tw57s 50m Normal AddedInterface pod/maas-api-revoke-sub-310a6533-tw57s Add eth0 [10.132.0.131/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-adb85511 Created pod: maas-api-revoke-sub-adb85511-ggbgs 50m Normal Pulled pod/maas-api-revoke-sub-310a6533-tw57s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal AddedInterface pod/maas-api-revoke-sub-adb85511-ggbgs Add eth0 [10.132.0.133/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-adb85511-ggbgs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Started pod/maas-api-revoke-sub-310a6533-tw57s Container started 50m Normal Created pod/maas-api-revoke-sub-310a6533-tw57s Container created 50m Normal Created pod/maas-api-revoke-sub-adb85511-ggbgs Container created 50m Normal Started pod/maas-api-revoke-sub-adb85511-ggbgs Container started 50m Normal Completed job/maas-api-revoke-sub-310a6533 Job completed 50m Normal Completed job/maas-api-revoke-sub-adb85511 Job completed 50m Normal AddedInterface pod/maas-api-revoke-sub-c6b8d54f-cqd6h Add eth0 [10.132.0.136/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-c6b8d54f-cqd6h Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal SuccessfulCreate job/maas-api-revoke-sub-c6b8d54f Created pod: maas-api-revoke-sub-c6b8d54f-cqd6h 50m Normal Started pod/maas-api-revoke-sub-c6b8d54f-cqd6h Container started 50m Normal Created pod/maas-api-revoke-sub-c6b8d54f-cqd6h Container created 50m Normal AddedInterface pod/maas-api-revoke-sub-28f44fd7-28mq7 Add eth0 [10.132.0.137/23] from ovn-kubernetes 50m Normal SuccessfulCreate job/maas-api-revoke-sub-28f44fd7 Created pod: maas-api-revoke-sub-28f44fd7-28mq7 50m Normal Pulled pod/maas-api-revoke-sub-28f44fd7-28mq7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Started pod/maas-api-revoke-sub-28f44fd7-28mq7 Container started 50m Normal Created pod/maas-api-revoke-sub-28f44fd7-28mq7 Container created 50m Normal Completed job/maas-api-revoke-sub-c6b8d54f Job completed 50m Normal Completed job/maas-api-revoke-sub-28f44fd7 Job completed 50m Normal SuccessfulCreate job/maas-api-revoke-sub-3e785762 Created pod: maas-api-revoke-sub-3e785762-kxk2c 50m Normal AddedInterface pod/maas-api-revoke-sub-3e785762-kxk2c Add eth0 [10.132.0.138/23] from ovn-kubernetes 50m Normal Pulled pod/maas-api-revoke-sub-3e785762-kxk2c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 50m Normal Created pod/maas-api-revoke-sub-3e785762-kxk2c Container created 50m Normal Started pod/maas-api-revoke-sub-3e785762-kxk2c Container started 50m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-b31c2926-6c6d8d88bb Created pod: maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd 50m Warning FailedMount pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ait-b31c2926-serving-cert" not found 50m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-b31c2926 Scaled up replica set maas-api-e2e-ait-b31c2926-6c6d8d88bb from 0 to 1 49m Normal Pulling pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 49m Normal AddedInterface pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd Add eth0 [10.132.0.139/23] from ovn-kubernetes 49m Normal Completed job/maas-api-revoke-sub-3e785762 Job completed 49m Normal Started pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd Container started 49m Normal Pulled pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 353ms (353ms including waiting). Image size: 194510193 bytes. 49m Normal Created pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd Container created 49m Normal ScalingReplicaSet deployment/maas-api-e2e-migrate-7e2137bc Scaled up replica set maas-api-e2e-migrate-7e2137bc-6b578c886f from 0 to 1 49m Normal SuccessfulCreate replicaset/maas-api-e2e-migrate-7e2137bc-6b578c886f Created pod: maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f 49m Normal Pulling pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 49m Normal AddedInterface pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Add eth0 [10.133.0.102/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 513ms (513ms including waiting). Image size: 194510193 bytes. 49m Normal Started pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Container started 49m Normal Created pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Container created 49m Normal SuccessfulCreate job/maas-api-revoke-sub-20713d97 Created pod: maas-api-revoke-sub-20713d97-v5dxz 49m Normal AddedInterface pod/maas-api-revoke-sub-20713d97-v5dxz Add eth0 [10.132.0.143/23] from ovn-kubernetes 49m Normal Pulled pod/maas-api-revoke-sub-20713d97-v5dxz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-sub-20713d97-v5dxz Container created 49m Normal Started pod/maas-api-revoke-sub-20713d97-v5dxz Container started 49m Normal Completed job/maas-api-revoke-sub-20713d97 Job completed 49m Normal AddedInterface pod/maas-api-revoke-sub-4f5dace6-dms2f Add eth0 [10.132.0.144/23] from ovn-kubernetes 49m Normal SuccessfulCreate job/maas-api-revoke-sub-4f5dace6 Created pod: maas-api-revoke-sub-4f5dace6-dms2f 49m Normal Pulled pod/maas-api-revoke-sub-4f5dace6-dms2f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Started pod/maas-api-revoke-sub-4f5dace6-dms2f Container started 49m Normal Created pod/maas-api-revoke-sub-4f5dace6-dms2f Container created 49m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-b31c2926-5qpgc Add eth0 [10.132.0.145/23] from ovn-kubernetes 49m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-migrate-7e2137bc Created pod: maas-api-revoke-keys-e2e-migrate-7e2137bc-7rp8t 49m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-b31c2926-5qpgc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-b31c2926 Created pod: maas-api-revoke-keys-e2e-ait-b31c2926-5qpgc 49m Normal Created pod/maas-api-revoke-keys-e2e-ait-b31c2926-5qpgc Container created 49m Normal Completed job/maas-api-revoke-sub-4f5dace6 Job completed 49m Normal AddedInterface pod/maas-api-revoke-keys-e2e-migrate-7e2137bc-7rp8t Add eth0 [10.132.0.146/23] from ovn-kubernetes 49m Normal Started pod/maas-api-revoke-keys-e2e-ait-b31c2926-5qpgc Container started 49m Normal Pulled pod/maas-api-revoke-keys-e2e-migrate-7e2137bc-7rp8t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal Created pod/maas-api-revoke-keys-e2e-migrate-7e2137bc-7rp8t Container created 49m Normal Started pod/maas-api-revoke-keys-e2e-migrate-7e2137bc-7rp8t Container started 49m Normal Completed job/maas-api-revoke-keys-e2e-ait-b31c2926 Job completed 49m Normal Completed job/maas-api-revoke-keys-e2e-migrate-7e2137bc Job completed 49m Normal SuccessfulCreate job/maas-api-revoke-sub-187291ac Created pod: maas-api-revoke-sub-187291ac-hk42z 49m Normal Pulled pod/maas-api-revoke-sub-187291ac-hk42z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 49m Normal AddedInterface pod/maas-api-revoke-sub-187291ac-hk42z Add eth0 [10.132.0.148/23] from ovn-kubernetes 49m Normal Started pod/maas-api-revoke-sub-187291ac-hk42z Container started 49m Normal Created pod/maas-api-revoke-sub-187291ac-hk42z Container created 49m Normal Killing pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Stopping container maas-api 49m Normal Killing pod/maas-api-e2e-ait-b31c2926-6c6d8d88bb-mblgd Stopping container maas-api 49m Warning Unhealthy pod/maas-api-e2e-migrate-7e2137bc-6b578c886f-bhb5f Readiness probe failed: Get "https://10.133.0.102:8443/health": dial tcp 10.133.0.102:8443: connect: connection refused 49m Normal Completed job/maas-api-revoke-sub-187291ac Job completed 48m Warning FailedMount pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-a-w2-8b77b0-serving-cert" not found 48m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w2-8b77b0 Scaled up replica set maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f from 0 to 1 48m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f Created pod: maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj 48m Normal AddedInterface pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj Add eth0 [10.133.0.113/23] from ovn-kubernetes 48m Normal Pulling pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal Started pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj Container started 48m Normal Created pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj Container created 48m Normal Pulled pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 385ms (385ms including waiting). Image size: 194510193 bytes. 48m Normal SuccessfulCreate replicaset/maas-api-e2e-ait-911fe1d6-7d9788c49 Created pod: maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 48m Normal ScalingReplicaSet deployment/maas-api-e2e-ait-911fe1d6 Scaled up replica set maas-api-e2e-ait-911fe1d6-7d9788c49 from 0 to 1 48m Normal Pulling pod/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal AddedInterface pod/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 Add eth0 [10.132.0.151/23] from ovn-kubernetes 48m Normal Created pod/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 Container created 48m Normal Started pod/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 Container started 48m Normal Pulled pod/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 373ms (373ms including waiting). Image size: 194510193 bytes. 48m Normal AddedInterface pod/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 Add eth0 [10.133.0.114/23] from ovn-kubernetes 48m Normal Pulling pod/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal SuccessfulCreate replicaset/maas-api-e2e-derive-45c4d25f-5b7f7bb64b Created pod: maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 48m Normal ScalingReplicaSet deployment/maas-api-e2e-derive-45c4d25f Scaled up replica set maas-api-e2e-derive-45c4d25f-5b7f7bb64b from 0 to 1 48m Normal Pulled pod/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 325ms (325ms including waiting). Image size: 194510193 bytes. 48m Normal Created pod/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 Container created 48m Normal Started pod/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 Container started 48m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-derive-45c4d25f Created pod: maas-api-revoke-keys-e2e-derive-45c4d25f-v876f 48m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ait-911fe1d6 Created pod: maas-api-revoke-keys-e2e-ait-911fe1d6-b8n2r 48m Normal Pulled pod/maas-api-revoke-keys-e2e-derive-45c4d25f-v876f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ait-911fe1d6-b8n2r Add eth0 [10.132.0.157/23] from ovn-kubernetes 48m Normal AddedInterface pod/maas-api-revoke-keys-e2e-derive-45c4d25f-v876f Add eth0 [10.132.0.156/23] from ovn-kubernetes 48m Normal Pulled pod/maas-api-revoke-keys-e2e-ait-911fe1d6-b8n2r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 48m Normal Started pod/maas-api-revoke-keys-e2e-derive-45c4d25f-v876f Container started 48m Normal Created pod/maas-api-revoke-keys-e2e-derive-45c4d25f-v876f Container created 48m Normal Started pod/maas-api-revoke-keys-e2e-ait-911fe1d6-b8n2r Container started 48m Normal Created pod/maas-api-revoke-keys-e2e-ait-911fe1d6-b8n2r Container created 48m Normal Completed job/maas-api-revoke-keys-e2e-ait-911fe1d6 Job completed 48m Normal Completed job/maas-api-revoke-keys-e2e-derive-45c4d25f Job completed 48m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67 Created pod: maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp 48m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w2-5a6281 Scaled up replica set maas-api-e2e-shared-b-w2-5a6281-6bbb86d67 from 0 to 1 48m Normal Pulled pod/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 632ms (632ms including waiting). Image size: 194510193 bytes. 48m Normal Pulling pod/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 48m Normal AddedInterface pod/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp Add eth0 [10.132.0.159/23] from ovn-kubernetes 48m Normal Started pod/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp Container started 48m Normal Killing pod/maas-api-e2e-ait-911fe1d6-7d9788c49-8snn5 Stopping container maas-api 48m Normal Created pod/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp Container created 48m Normal Killing pod/maas-api-e2e-derive-45c4d25f-5b7f7bb64b-lpqj5 Stopping container maas-api 47m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-df6c3661-6695779d4 Created pod: maas-api-e2e-mt-df6c3661-6695779d4-qmmrl 47m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-df6c3661 Scaled up replica set maas-api-e2e-mt-df6c3661-6695779d4 from 0 to 1 47m Normal Pulled pod/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 387ms (387ms including waiting). Image size: 194510193 bytes. 47m Normal Pulling pod/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 47m Normal AddedInterface pod/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl Add eth0 [10.132.0.164/23] from ovn-kubernetes 47m Normal Started pod/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl Container started 47m Normal Created pod/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl Container created 47m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-3778dacd-5df6bbbb7b Created pod: maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz 47m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-3778dacd Scaled up replica set maas-api-e2e-mt-3778dacd-5df6bbbb7b from 0 to 1 47m Warning FailedMount pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-mt-3778dacd-serving-cert" not found 47m Normal SuccessfulCreate job/maas-api-revoke-sub-5b39a67e Created pod: maas-api-revoke-sub-5b39a67e-6swfj 47m Normal Pulling pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 47m Normal Pulled pod/maas-api-revoke-sub-5b39a67e-6swfj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 47m Normal AddedInterface pod/maas-api-revoke-sub-5b39a67e-6swfj Add eth0 [10.132.0.165/23] from ovn-kubernetes 47m Normal Started pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz Container started 47m Normal Created pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz Container created 47m Normal AddedInterface pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz Add eth0 [10.134.0.72/23] from ovn-kubernetes 47m Normal Pulled pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 286ms (286ms including waiting). Image size: 194510193 bytes. 47m Normal Created pod/maas-api-revoke-sub-5b39a67e-6swfj Container created 47m Normal Started pod/maas-api-revoke-sub-5b39a67e-6swfj Container started 47m Normal Completed job/maas-api-revoke-sub-5b39a67e Job completed 47m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w4-f0a31b Scaled up replica set maas-api-e2e-shared-a-w4-f0a31b-7847747b5b from 0 to 1 47m Warning FailedMount pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-a-w4-f0a31b-serving-cert" not found 47m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b Created pod: maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 47m Normal Pulling pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 47m Normal AddedInterface pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 Add eth0 [10.132.0.166/23] from ovn-kubernetes 47m Normal Created pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 Container created 47m Normal Started pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 Container started 47m Normal Pulled pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 413ms (413ms including waiting). Image size: 194510193 bytes. 46m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-fafb3f Scaled up replica set maas-api-e2e-api-a-fafb3f-67dcbc6496 from 0 to 1 46m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-fafb3f-67dcbc6496 Created pod: maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 46m Normal Created pod/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 Container created 46m Normal Pulled pod/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 363ms (363ms including waiting). Image size: 194510193 bytes. 46m Normal Pulling pod/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 46m Normal AddedInterface pod/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 Add eth0 [10.132.0.168/23] from ovn-kubernetes 46m Normal Started pod/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 Container started 46m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w4-b29df4 Scaled up replica set maas-api-e2e-shared-b-w4-b29df4-86bb6fd959 from 0 to 1 46m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959 Created pod: maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz 46m Warning FailedMount pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-b-w4-b29df4-serving-cert" not found 46m Normal AddedInterface pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Add eth0 [10.134.0.80/23] from ovn-kubernetes 46m Normal Pulling pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 46m Normal Pulled pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 424ms (424ms including waiting). Image size: 194510193 bytes. 46m Normal Started pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Container started 46m Normal Created pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Container created 46m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-659d72-77bcc947b5 Created pod: maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl 46m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-659d72 Scaled up replica set maas-api-e2e-api-a-659d72-77bcc947b5 from 0 to 1 46m Normal AddedInterface pod/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl Add eth0 [10.132.0.170/23] from ovn-kubernetes 46m Normal Pulling pod/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 46m Normal Pulled pod/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 477ms (477ms including waiting). Image size: 194510193 bytes. 46m Normal Created pod/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl Container created 46m Normal Started pod/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl Container started 45m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-df6c3661 Created pod: maas-api-revoke-keys-e2e-mt-df6c3661-5tfnb 45m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-df6c3661-5tfnb Add eth0 [10.133.0.131/23] from ovn-kubernetes 45m Normal Started pod/maas-api-revoke-keys-e2e-mt-df6c3661-5tfnb Container started 45m Normal Created pod/maas-api-revoke-keys-e2e-mt-df6c3661-5tfnb Container created 45m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-df6c3661-5tfnb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Completed job/maas-api-revoke-keys-e2e-mt-df6c3661 Job completed 45m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-6b0881-7db7ff89cb Created pod: maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg 45m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-6b0881 Scaled up replica set maas-api-e2e-api-b-6b0881-7db7ff89cb from 0 to 1 45m Normal Started pod/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg Container started 45m Normal Created pod/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg Container created 45m Normal Pulled pod/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 380ms (380ms including waiting). Image size: 194510193 bytes. 45m Normal Pulling pod/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 45m Normal AddedInterface pod/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg Add eth0 [10.134.0.85/23] from ovn-kubernetes 45m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-3778dacd Created pod: maas-api-revoke-keys-e2e-mt-3778dacd-fqdm6 45m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-3778dacd-fqdm6 Add eth0 [10.133.0.133/23] from ovn-kubernetes 45m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-3778dacd-fqdm6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Started pod/maas-api-revoke-keys-e2e-mt-3778dacd-fqdm6 Container started 45m Normal Created pod/maas-api-revoke-keys-e2e-mt-3778dacd-fqdm6 Container created 45m Normal Completed job/maas-api-revoke-keys-e2e-mt-3778dacd Job completed 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435 Created pod: maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-mt-3778dacd-29889435 Created pod: maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435 Created pod: maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435 Created pod: maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-a-659d72 Created job maas-api-key-cleanup-e2e-api-a-659d72-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-e34fd5 Created job maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-a-659d72-29889435 Created pod: maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w2-5a6281 Created job maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-b-6b0881 Created job maas-api-key-cleanup-e2e-api-b-6b0881-29889435 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Add eth0 [10.134.0.86/23] from ovn-kubernetes 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-b-6b0881-29889435 Created pod: maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b Created job maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-mt-df6c3661 Created job maas-api-key-cleanup-e2e-mt-df6c3661-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-52a649 Created job maas-api-key-cleanup-e2e-worker-w1-52a649-29889435 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-mt-df6c3661-29889435 Created pod: maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-cb58b8 Created job maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-d833bd Created job maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435 Created pod: maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435 Created pod: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf 45m Normal SuccessfulCreate job/maas-api-key-cleanup-29889435 Created pod: maas-api-key-cleanup-29889435-dlkxh 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-api-a-fafb3f Created job maas-api-key-cleanup-e2e-api-a-fafb3f-29889435 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435 Created pod: maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435 Created pod: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0 Created job maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435 Created pod: maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435 Created pod: maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435 Created pod: maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-f07dfe Created job maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435 Created pod: maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w4-b29df4 Created job maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435 45m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435 Created pod: maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-d7e62b Created job maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-mt-3778dacd Created job maas-api-key-cleanup-e2e-mt-3778dacd-29889435 45m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-ee7d65 Created job maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 Add eth0 [10.133.0.137/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Add eth0 [10.134.0.87/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-29889435-dlkxh Add eth0 [10.134.0.89/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Add eth0 [10.134.0.88/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n Add eth0 [10.133.0.136/23] from ovn-kubernetes 45m Normal Pulling pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 45m Normal Pulling pod/maas-api-key-cleanup-29889435-dlkxh Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 45m Normal Pulling pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 45m Normal Pulling pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Pulling image "registry.redhat.io/ubi9/ubi-minimal:9.7" 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f Add eth0 [10.133.0.143/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf Add eth0 [10.133.0.140/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn Add eth0 [10.133.0.145/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r Add eth0 [10.133.0.138/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv Add eth0 [10.133.0.146/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb Add eth0 [10.133.0.142/23] from ovn-kubernetes 45m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-9fcb69-6f45cd6b55 Created pod: maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r Add eth0 [10.133.0.141/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv Add eth0 [10.133.0.139/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx Add eth0 [10.133.0.144/23] from ovn-kubernetes 45m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-9fcb69 Scaled up replica set maas-api-e2e-api-a-9fcb69-6f45cd6b55 from 0 to 1 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml Add eth0 [10.132.0.174/23] from ovn-kubernetes 45m Normal AddedInterface pod/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd Add eth0 [10.132.0.173/23] from ovn-kubernetes 45m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55 Created pod: maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp 45m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w6-9c6033 Scaled up replica set maas-api-e2e-shared-a-w6-9c6033-79d5f6db55 from 0 to 1 45m Normal Pulled pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 5.949s (5.949s including waiting). Image size: 107195206 bytes. 45m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 5.887s (5.887s including waiting). Image size: 107195206 bytes. 45m Normal Pulled pod/maas-api-key-cleanup-29889435-dlkxh Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 5.893s (5.893s including waiting). Image size: 107195206 bytes. 45m Normal Pulled pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Successfully pulled image "registry.redhat.io/ubi9/ubi-minimal:9.7" in 5.888s (5.888s including waiting). Image size: 107195206 bytes. 45m Normal SuccessfulCreate job/maas-api-revoke-sub-774b5079 Created pod: maas-api-revoke-sub-774b5079-rnk2n 45m Normal Pulled pod/maas-api-revoke-sub-774b5079-rnk2n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal AddedInterface pod/maas-api-revoke-sub-774b5079-rnk2n Add eth0 [10.133.0.149/23] from ovn-kubernetes 45m Normal ScalingReplicaSet deployment/maas-api-e2e-api-a-8af0fe Scaled up replica set maas-api-e2e-api-a-8af0fe-6c66bcb66d from 0 to 1 45m Normal SuccessfulCreate replicaset/maas-api-e2e-api-a-8af0fe-6c66bcb66d Created pod: maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p 45m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Started pod/maas-api-revoke-sub-774b5079-rnk2n Container started 45m Normal Created pod/maas-api-revoke-sub-774b5079-rnk2n Container created 45m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Started pod/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd Container started 45m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n Container created 45m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Pulled pod/maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 Container created 45m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Pulled pod/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 45m Normal Created pod/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd Container created 45m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 Container started 45m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n Container started 44m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r Container created 44m Normal Created pod/maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx Container created 44m Normal Started pod/maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx Container started 44m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn Container started 44m Warning BackOff pod/maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd_odh-ai-gateway-infra(6a556e12-40f6-473c-9608-12770d2ab66b) 44m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8_odh-ai-gateway-infra(1c581513-81ee-42a4-ad45-2ae012744caf) 44m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f Container created 44m Normal Pulled pod/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n_odh-ai-gateway-infra(b2e90cd6-1c18-4edb-ae15-7caed4920fe5) 44m Normal Started pod/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml Container started 44m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f Container started 44m Normal Created pod/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml Container created 44m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb Container created 44m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb Container started 44m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn Container created 44m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv Container started 44m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv Container created 44m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r Container started 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-mt-df6c3661-29889435 Deleted pod: maas-api-key-cleanup-e2e-mt-df6c3661-29889435-7rlwd 44m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf Container started 44m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf Container created 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-api-b-6b0881-29889435 Deleted pod: maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435-25tf8 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435-2fb6n 44m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r Container created 44m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r Container started 44m Normal Completed job/maas-api-revoke-sub-774b5079 Job completed 44m Warning BackOff pod/maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-api-b-6b0881-29889435-2wwml_odh-ai-gateway-infra(033eca56-a80a-4b76-bc36-78090b327c9a) 44m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf_odh-ai-gateway-infra(cbd3c692-16b9-44ea-98a9-1aa8852f7100) 44m Normal Created pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Container created 44m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r_odh-ai-gateway-infra(dabc5857-b065-4205-a160-48118225ee82) 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-mt-df6c3661-29889435 Job has reached the specified backoff limit 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435 Deleted pod: maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435-kgl8r 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-mt-df6c3661 Saw completed job: maas-api-key-cleanup-e2e-mt-df6c3661-29889435, condition: Failed 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-api-a-659d72-29889435 Deleted pod: maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx 44m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Warning BackOff pod/maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-api-a-659d72-29889435-zl5cx_odh-ai-gateway-infra(6dc41559-3131-4c6d-bef5-f5cae1150954) 44m Normal Pulled pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal Started pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Container started 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb 44m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-52a649-29889435-vhbwb_odh-ai-gateway-infra(77ada86d-3625-4786-a01d-2c422fdf7049) 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn 44m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435-wkpwn_odh-ai-gateway-infra(0187e742-2686-400f-bb53-c74b0d65b5a8) 44m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r_odh-ai-gateway-infra(5b7b85af-fbe9-4a34-b0d6-16068595c558) 44m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435-9sk2f_odh-ai-gateway-infra(98232f3c-5612-48bf-b272-439425a1fe37) 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435 Job has reached the specified backoff limit 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435 Job has reached the specified backoff limit 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-cb58b8 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889435, condition: Failed 44m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv_odh-ai-gateway-infra(4ec36a29-9692-4a74-8297-c73fff6ab164) 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435-65zmv 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-d7e62b Saw completed job: maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889435, condition: Failed 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435-5cb9r 44m Warning BackOff pod/maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn_odh-ai-gateway-infra(3e792233-9490-4134-acce-5584ab43123a) 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435-km6bf 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-api-b-6b0881-29889435 Job has reached the specified backoff limit 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-api-b-6b0881 Saw completed job: maas-api-key-cleanup-e2e-api-b-6b0881-29889435, condition: Failed 44m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv Container created 44m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv Container started 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b Saw completed job: maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435, condition: Failed 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-52a649-29889435 Job has reached the specified backoff limit 44m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv_odh-ai-gateway-infra(d75b5256-b21b-47d6-8acb-45cb0afe1190) 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w2-5a6281 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435, condition: Failed 44m Normal Pulling pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6_odh-ai-gateway-infra(a0aace59-a54a-447a-ba91-3ab588b2c2fe) 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435 Job has reached the specified backoff limit 44m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Container started 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-api-a-659d72 Saw completed job: maas-api-key-cleanup-e2e-api-a-659d72-29889435, condition: Failed 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-mt-3778dacd-29889435 Deleted pod: maas-api-key-cleanup-e2e-mt-3778dacd-29889435-fbxfn 44m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 Container created 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435, condition: Failed 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-api-a-659d72-29889435 Job has reached the specified backoff limit 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-52a649 Saw completed job: maas-api-key-cleanup-e2e-worker-w1-52a649-29889435, condition: Failed 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-e34fd5 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889435, condition: Failed 44m Normal AddedInterface pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p Add eth0 [10.133.0.150/23] from ovn-kubernetes 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889435 Job has reached the specified backoff limit 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889435 Job has reached the specified backoff limit 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889435 Job has reached the specified backoff limit 44m Normal Pulled pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435-c6pcv 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w0-f07dfe Saw completed job: maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435, condition: Failed 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435-mxkd6 44m Normal Pulled pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 448ms (448ms including waiting). Image size: 194510193 bytes. 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-d833bd Saw completed job: maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435, condition: Failed 44m Normal Killing pod/maas-api-e2e-mt-3778dacd-5df6bbbb7b-h26tz Stopping container maas-api 44m Normal Created pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p Container created 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889435 Job has reached the specified backoff limit 44m Normal Started pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p Container started 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889435 Job has reached the specified backoff limit 44m Normal Created pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Container created 44m Normal Created pod/maas-api-key-cleanup-29889435-dlkxh Container created 44m Normal Started pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Container started 44m Normal Pulling pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal AddedInterface pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp Add eth0 [10.134.0.90/23] from ovn-kubernetes 44m Normal Pulled pod/maas-api-key-cleanup-29889435-dlkxh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435 Job has reached the specified backoff limit 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w4-b29df4 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889435, condition: Failed 44m Warning BackOff pod/maas-api-key-cleanup-29889435-dlkxh Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29889435-dlkxh_odh-ai-gateway-infra(9ede3d71-cc65-4660-b836-6f05f27ea6cc) 44m Normal Pulled pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 363ms (363ms including waiting). Image size: 194510193 bytes. 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435 Job has reached the specified backoff limit 44m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435 Deleted pod: maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp 44m Normal Started pod/maas-api-key-cleanup-29889435-dlkxh Container started 44m Normal Started pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp Container started 44m Normal Created pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp Container created 44m Warning BackOff pod/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-api-a-fafb3f-29889435-lzjzp_odh-ai-gateway-infra(9d86f05b-db3f-417f-b5ab-395ebcbb4a0e) 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-ee7d65 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889435, condition: Failed 44m Normal SuccessfulDelete job/maas-api-key-cleanup-29889435 Deleted pod: maas-api-key-cleanup-29889435-dlkxh 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-api-a-fafb3f Saw completed job: maas-api-key-cleanup-e2e-api-a-fafb3f-29889435, condition: Failed 44m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29889435, condition: Failed 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29889435 Job has reached the specified backoff limit 44m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-api-a-fafb3f-29889435 Job has reached the specified backoff limit 44m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-fafb3f Created pod: maas-api-revoke-keys-e2e-api-a-fafb3f-cf6wb 44m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-fafb3f-cf6wb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-fafb3f-cf6wb Add eth0 [10.133.0.151/23] from ovn-kubernetes 44m Normal Pulled pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 343ms (343ms including waiting). Image size: 194510193 bytes. 44m Normal Started pod/maas-api-revoke-keys-e2e-api-a-fafb3f-cf6wb Container started 44m Normal Created pod/maas-api-revoke-keys-e2e-api-a-fafb3f-cf6wb Container created 44m Normal Started pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Container started 44m Normal Created pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Container created 44m Normal AddedInterface pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Add eth0 [10.133.0.152/23] from ovn-kubernetes 44m Normal Pulling pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal Completed job/maas-api-revoke-keys-e2e-api-a-fafb3f Job completed 44m Normal Pulled pod/maas-api-revoke-sub-a3d3ba8b-q2sw5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 44m Normal AddedInterface pod/maas-api-revoke-sub-a3d3ba8b-q2sw5 Add eth0 [10.133.0.153/23] from ovn-kubernetes 44m Normal SuccessfulCreate job/maas-api-revoke-sub-a3d3ba8b Created pod: maas-api-revoke-sub-a3d3ba8b-q2sw5 44m Normal Created pod/maas-api-revoke-sub-a3d3ba8b-q2sw5 Container created 44m Normal Started pod/maas-api-revoke-sub-a3d3ba8b-q2sw5 Container started 44m Normal Completed job/maas-api-revoke-sub-a3d3ba8b Job completed 44m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-2daeae-76cf799c89 Created pod: maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx 44m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-2daeae Scaled up replica set maas-api-e2e-api-b-2daeae-76cf799c89 from 0 to 1 44m Normal AddedInterface pod/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx Add eth0 [10.133.0.154/23] from ovn-kubernetes 44m Normal Started pod/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx Container started 44m Normal Created pod/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx Container created 44m Normal Pulling pod/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 44m Normal Pulled pod/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 385ms (385ms including waiting). Image size: 194510193 bytes. 44m Normal Killing pod/maas-api-e2e-mt-df6c3661-6695779d4-qmmrl Stopping container maas-api 43m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-84942a-7d58989cc9 Created pod: maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j 43m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-84942a Scaled up replica set maas-api-e2e-api-b-84942a-7d58989cc9 from 0 to 1 43m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-659d72 Created pod: maas-api-revoke-keys-e2e-api-a-659d72-8glwc 43m Normal Pulling pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 43m Normal AddedInterface pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Add eth0 [10.133.0.162/23] from ovn-kubernetes 43m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-659d72-8glwc Add eth0 [10.133.0.163/23] from ovn-kubernetes 43m Normal Pulled pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 658ms (658ms including waiting). Image size: 194510193 bytes. 43m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-659d72-8glwc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 43m Normal Created pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Container created 43m Normal Started pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Container started 43m Normal Started pod/maas-api-revoke-keys-e2e-api-a-659d72-8glwc Container started 43m Normal Created pod/maas-api-revoke-keys-e2e-api-a-659d72-8glwc Container created 43m Normal Completed job/maas-api-revoke-keys-e2e-api-a-659d72 Job completed 43m Normal Killing pod/maas-api-e2e-api-a-fafb3f-67dcbc6496-r2pg2 Stopping container maas-api 43m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5 Created pod: maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw 43m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w6-cda0d9 Scaled up replica set maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5 from 0 to 1 43m Normal Pulling pod/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 43m Normal AddedInterface pod/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw Add eth0 [10.132.0.178/23] from ovn-kubernetes 43m Normal Created pod/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw Container created 43m Normal Started pod/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw Container started 43m Normal Pulled pod/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 482ms (483ms including waiting). Image size: 194510193 bytes. 43m Normal AddedInterface pod/maas-api-e2e-mt-df6c3661-6695779d4-hg824 Add eth0 [10.134.0.92/23] from ovn-kubernetes 43m Normal Pulling pod/maas-api-e2e-mt-df6c3661-6695779d4-hg824 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 43m Normal ScalingReplicaSet deployment/maas-api-e2e-mt-df6c3661 Scaled up replica set maas-api-e2e-mt-df6c3661-6695779d4 from 0 to 1 43m Normal SuccessfulCreate replicaset/maas-api-e2e-mt-df6c3661-6695779d4 Created pod: maas-api-e2e-mt-df6c3661-6695779d4-hg824 43m Normal Started pod/maas-api-e2e-mt-df6c3661-6695779d4-hg824 Container started 43m Normal Created pod/maas-api-e2e-mt-df6c3661-6695779d4-hg824 Container created 43m Normal Pulled pod/maas-api-e2e-mt-df6c3661-6695779d4-hg824 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 327ms (327ms including waiting). Image size: 194510193 bytes. 43m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-6b0881-82hrm Add eth0 [10.132.0.179/23] from ovn-kubernetes 43m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-6b0881-82hrm Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 43m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-6b0881 Created pod: maas-api-revoke-keys-e2e-api-b-6b0881-82hrm 43m Normal Created pod/maas-api-revoke-keys-e2e-api-b-6b0881-82hrm Container created 43m Normal Started pod/maas-api-revoke-keys-e2e-api-b-6b0881-82hrm Container started 43m Warning FailedMount pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-api-b-4644a1-serving-cert" not found 43m Normal ScalingReplicaSet deployment/maas-api-e2e-api-b-4644a1 Scaled up replica set maas-api-e2e-api-b-4644a1-74d9f89479 from 0 to 1 43m Normal SuccessfulCreate replicaset/maas-api-e2e-api-b-4644a1-74d9f89479 Created pod: maas-api-e2e-api-b-4644a1-74d9f89479-27l8l 43m Normal AddedInterface pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l Add eth0 [10.134.0.93/23] from ovn-kubernetes 43m Normal Pulling pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 43m Normal Completed job/maas-api-revoke-keys-e2e-api-b-6b0881 Job completed 43m Normal Started pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l Container started 43m Normal Created pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l Container created 43m Normal Pulled pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 445ms (445ms including waiting). Image size: 194510193 bytes. 43m Normal SuccessfulCreate job/maas-api-revoke-sub-5989e3ed Created pod: maas-api-revoke-sub-5989e3ed-224rs 43m Normal Pulled pod/maas-api-revoke-sub-5989e3ed-224rs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 43m Normal AddedInterface pod/maas-api-revoke-sub-5989e3ed-224rs Add eth0 [10.132.0.180/23] from ovn-kubernetes 42m Normal Started pod/maas-api-revoke-sub-5989e3ed-224rs Container started 42m Normal Created pod/maas-api-revoke-sub-5989e3ed-224rs Container created 42m Normal Completed job/maas-api-revoke-sub-5989e3ed Job completed 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-9fcb69 Created pod: maas-api-revoke-keys-e2e-api-a-9fcb69-scjck 42m Normal Started pod/maas-api-revoke-keys-e2e-api-a-9fcb69-scjck Container started 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-9fcb69-scjck Add eth0 [10.132.0.181/23] from ovn-kubernetes 42m Normal Created pod/maas-api-revoke-keys-e2e-api-a-9fcb69-scjck Container created 42m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-9fcb69-scjck Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal Completed job/maas-api-revoke-keys-e2e-api-a-9fcb69 Job completed 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-a-8af0fe Created pod: maas-api-revoke-keys-e2e-api-a-8af0fe-47bdr 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-a-8af0fe-47bdr Add eth0 [10.132.0.183/23] from ovn-kubernetes 42m Normal Started pod/maas-api-revoke-keys-e2e-api-a-8af0fe-47bdr Container started 42m Normal Created pod/maas-api-revoke-keys-e2e-api-a-8af0fe-47bdr Container created 42m Normal Pulled pod/maas-api-revoke-keys-e2e-api-a-8af0fe-47bdr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-mt-df6c3661-wg5kt Add eth0 [10.132.0.186/23] from ovn-kubernetes 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-mt-df6c3661 Created pod: maas-api-revoke-keys-e2e-mt-df6c3661-wg5kt 42m Normal Completed job/maas-api-revoke-keys-e2e-api-a-8af0fe Job completed 42m Normal Pulled pod/maas-api-revoke-keys-e2e-mt-df6c3661-wg5kt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal Started pod/maas-api-revoke-keys-e2e-mt-df6c3661-wg5kt Container started 42m Normal Created pod/maas-api-revoke-keys-e2e-mt-df6c3661-wg5kt Container created 42m Normal Completed job/maas-api-revoke-keys-e2e-mt-df6c3661 Job completed 42m Normal Killing pod/maas-api-e2e-api-a-659d72-77bcc947b5-lrvgl Stopping container maas-api 42m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-2daeae Created pod: maas-api-revoke-keys-e2e-api-b-2daeae-kb8p9 42m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-2daeae-kb8p9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 42m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-2daeae-kb8p9 Add eth0 [10.132.0.187/23] from ovn-kubernetes 42m Normal Started pod/maas-api-revoke-keys-e2e-api-b-2daeae-kb8p9 Container started 42m Normal Created pod/maas-api-revoke-keys-e2e-api-b-2daeae-kb8p9 Container created 42m Normal Completed job/maas-api-revoke-keys-e2e-api-b-2daeae Job completed 42m Normal Killing pod/maas-api-e2e-mt-df6c3661-6695779d4-hg824 Stopping container maas-api 42m Normal Killing pod/maas-api-e2e-api-b-6b0881-7db7ff89cb-fc2bg Stopping container maas-api 42m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-77254d-55f7f48fd6 Created pod: maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 42m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-77254d Scaled up replica set maas-api-e2e-inf-a-77254d-55f7f48fd6 from 0 to 1 42m Normal Started pod/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 Container started 42m Normal Pulling pod/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 42m Normal AddedInterface pod/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 Add eth0 [10.133.0.164/23] from ovn-kubernetes 42m Normal Pulled pod/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 494ms (494ms including waiting). Image size: 194510193 bytes. 42m Normal Created pod/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 Container created 41m Normal Killing pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Stopping container maas-api 41m Warning Unhealthy pod/maas-api-e2e-api-a-9fcb69-6f45cd6b55-7z62k Readiness probe failed: Get "https://10.133.0.152:8443/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 41m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-84942a Created pod: maas-api-revoke-keys-e2e-api-b-84942a-ttm66 41m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-84942a-ttm66 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-84942a-ttm66 Add eth0 [10.132.0.189/23] from ovn-kubernetes 41m Normal Created pod/maas-api-revoke-keys-e2e-api-b-84942a-ttm66 Container created 41m Normal Started pod/maas-api-revoke-keys-e2e-api-b-84942a-ttm66 Container started 41m Normal Completed job/maas-api-revoke-keys-e2e-api-b-84942a Job completed 41m Normal Killing pod/maas-api-e2e-api-a-8af0fe-6c66bcb66d-lh75p Stopping container maas-api 41m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-api-b-4644a1 Created pod: maas-api-revoke-keys-e2e-api-b-4644a1-cxndr 41m Normal AddedInterface pod/maas-api-revoke-keys-e2e-api-b-4644a1-cxndr Add eth0 [10.132.0.190/23] from ovn-kubernetes 41m Normal Started pod/maas-api-revoke-keys-e2e-api-b-4644a1-cxndr Container started 41m Normal Created pod/maas-api-revoke-keys-e2e-api-b-4644a1-cxndr Container created 41m Normal Pulled pod/maas-api-revoke-keys-e2e-api-b-4644a1-cxndr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-b5a369-75cdb8ddd5 Created pod: maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd 41m Warning FailedMount pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-a-b5a369-serving-cert" not found 41m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-b5a369 Scaled up replica set maas-api-e2e-inf-a-b5a369-75cdb8ddd5 from 0 to 1 41m Normal Pulling pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 41m Normal AddedInterface pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Add eth0 [10.134.0.96/23] from ovn-kubernetes 41m Normal Pulled pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 324ms (324ms including waiting). Image size: 194510193 bytes. 41m Normal Started pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Container started 41m Normal Created pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Container created 41m Normal Completed job/maas-api-revoke-keys-e2e-api-b-4644a1 Job completed 41m Normal SuccessfulCreate job/maas-api-revoke-sub-fb670967 Created pod: maas-api-revoke-sub-fb670967-ng6z6 41m Normal Pulled pod/maas-api-revoke-sub-fb670967-ng6z6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 41m Normal AddedInterface pod/maas-api-revoke-sub-fb670967-ng6z6 Add eth0 [10.132.0.192/23] from ovn-kubernetes 41m Normal Started pod/maas-api-revoke-sub-fb670967-ng6z6 Container started 41m Normal Created pod/maas-api-revoke-sub-fb670967-ng6z6 Container created 41m Normal Killing pod/maas-api-e2e-api-b-2daeae-76cf799c89-c8sgx Stopping container maas-api 41m Normal Completed job/maas-api-revoke-sub-fb670967 Job completed 40m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-ddb271 Scaled up replica set maas-api-e2e-inf-b-ddb271-676674db6 from 0 to 1 40m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-ddb271-676674db6 Created pod: maas-api-e2e-inf-b-ddb271-676674db6-w4mhq 40m Normal Pulling pod/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal AddedInterface pod/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq Add eth0 [10.132.0.194/23] from ovn-kubernetes 40m Normal Pulled pod/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 366ms (366ms including waiting). Image size: 194510193 bytes. 40m Normal Created pod/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq Container created 40m Normal Started pod/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq Container started 40m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-31721c Scaled up replica set maas-api-e2e-inf-a-31721c-5b5f798fb8 from 0 to 1 40m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-31721c-5b5f798fb8 Created pod: maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm 40m Normal Pulling pod/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal AddedInterface pod/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm Add eth0 [10.134.0.99/23] from ovn-kubernetes 40m Normal Pulled pod/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 445ms (445ms including waiting). Image size: 194510193 bytes. 40m Normal Created pod/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm Container created 40m Normal Started pod/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm Container started 40m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-api-b-84942a Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-api-b-84942a: Operation cannot be fulfilled on endpoints "maas-api-e2e-api-b-84942a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-api-b-84942a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6478658e-1fe3-4734-9c3f-26170f837ba0, UID in object meta: 40m Normal Killing pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Stopping container maas-api 40m Warning Unhealthy pod/maas-api-e2e-api-b-84942a-7d58989cc9-j2l2j Readiness probe failed: Get "https://10.133.0.162:8443/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 40m Normal AddedInterface pod/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb Add eth0 [10.133.0.176/23] from ovn-kubernetes 40m Normal Pulling pod/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c Created pod: maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb 40m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w1-ff4285 Scaled up replica set maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c from 0 to 1 40m Normal Created pod/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb Container created 40m Normal Pulled pod/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 379ms (379ms including waiting). Image size: 194510193 bytes. 40m Normal Started pod/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb Container started 40m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-0ad384 Scaled up replica set maas-api-e2e-inf-a-0ad384-9f75b9b47 from 0 to 1 40m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-0ad384-9f75b9b47 Created pod: maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx 40m Normal AddedInterface pod/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx Add eth0 [10.132.0.196/23] from ovn-kubernetes 40m Normal Pulling pod/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 40m Normal Pulled pod/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 298ms (298ms including waiting). Image size: 194510193 bytes. 40m Normal Started pod/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx Container started 40m Normal Created pod/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx Container created 40m Normal Killing pod/maas-api-e2e-api-b-4644a1-74d9f89479-27l8l Stopping container maas-api 39m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-8467ed Scaled up replica set maas-api-e2e-inf-b-8467ed-76766c9c88 from 0 to 1 39m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-8467ed-76766c9c88 Created pod: maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d 39m Normal Pulling pod/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 39m Normal Pulled pod/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 375ms (375ms including waiting). Image size: 194510193 bytes. 39m Normal Created pod/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d Container created 39m Normal Started pod/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d Container started 39m Normal AddedInterface pod/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d Add eth0 [10.133.0.183/23] from ovn-kubernetes 39m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-47628d-587b5897c6 Created pod: maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk 39m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-47628d Scaled up replica set maas-api-e2e-inf-a-47628d-587b5897c6 from 0 to 1 39m Normal Pulled pod/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 434ms (434ms including waiting). Image size: 194510193 bytes. 39m Normal Pulling pod/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 39m Normal AddedInterface pod/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk Add eth0 [10.132.0.200/23] from ovn-kubernetes 39m Normal Started pod/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk Container started 39m Normal Created pod/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk Container created 39m Normal Pulling pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 39m Normal AddedInterface pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Add eth0 [10.134.0.104/23] from ovn-kubernetes 39m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-a-4651e8 Scaled up replica set maas-api-e2e-inf-a-4651e8-b6896f56d from 0 to 1 39m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-a-4651e8-b6896f56d Created pod: maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst 39m Normal Started pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Container started 39m Normal Pulled pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 344ms (344ms including waiting). Image size: 194510193 bytes. 39m Normal Created pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Container created 39m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-5dd8cc Scaled up replica set maas-api-e2e-inf-b-5dd8cc-657cd56d9c from 0 to 1 39m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-5dd8cc-657cd56d9c Created pod: maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v 39m Normal AddedInterface pod/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v Add eth0 [10.133.0.187/23] from ovn-kubernetes 39m Normal Pulling pod/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 39m Normal Pulled pod/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 542ms (542ms including waiting). Image size: 194510193 bytes. 39m Normal Started pod/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v Container started 39m Normal Created pod/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v Container created 38m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b Created pod: maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk 38m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w1-8d82d5 Scaled up replica set maas-api-e2e-shared-b-w1-8d82d5-65c88b865b from 0 to 1 38m Normal Pulling pod/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 38m Normal Pulled pod/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 382ms (382ms including waiting). Image size: 194510193 bytes. 38m Normal AddedInterface pod/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk Add eth0 [10.133.0.190/23] from ovn-kubernetes 38m Normal Started pod/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk Container started 38m Normal Created pod/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk Container created 38m Normal AddedInterface pod/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g Add eth0 [10.132.0.203/23] from ovn-kubernetes 38m Normal Pulling pod/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 38m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-09e4c0 Scaled up replica set maas-api-e2e-inf-b-09e4c0-67558bd879 from 0 to 1 38m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-09e4c0-67558bd879 Created pod: maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g 38m Normal Created pod/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g Container created 38m Normal Pulled pod/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 359ms (359ms including waiting). Image size: 194510193 bytes. 38m Normal Started pod/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g Container started 37m Warning FailedMount pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-inf-b-5c7ba3-serving-cert" not found 37m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-5c7ba3 Scaled up replica set maas-api-e2e-inf-b-5c7ba3-574966bcc5 from 0 to 1 37m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-5c7ba3-574966bcc5 Created pod: maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk 37m Normal Started pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk Container started 37m Normal Created pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk Container created 37m Normal Pulled pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 336ms (336ms including waiting). Image size: 194510193 bytes. 37m Normal Pulling pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 37m Normal AddedInterface pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk Add eth0 [10.133.0.194/23] from ovn-kubernetes 37m Normal ScalingReplicaSet deployment/maas-api-e2e-inf-b-376c89 Scaled up replica set maas-api-e2e-inf-b-376c89-8bd64fb6d from 0 to 1 37m Normal SuccessfulCreate replicaset/maas-api-e2e-inf-b-376c89-8bd64fb6d Created pod: maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq 37m Normal Started pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Container started 37m Normal Pulling pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 37m Normal Pulled pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 327ms (327ms including waiting). Image size: 194510193 bytes. 37m Normal Created pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Container created 37m Normal AddedInterface pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Add eth0 [10.132.0.206/23] from ovn-kubernetes 36m Normal SuccessfulCreate job/maas-api-revoke-sub-ee526181 Created pod: maas-api-revoke-sub-ee526181-gxxh9 36m Normal Started pod/maas-api-revoke-sub-ee526181-gxxh9 Container started 36m Normal Created pod/maas-api-revoke-sub-ee526181-gxxh9 Container created 36m Normal Pulled pod/maas-api-revoke-sub-ee526181-gxxh9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 36m Normal AddedInterface pod/maas-api-revoke-sub-ee526181-gxxh9 Add eth0 [10.132.0.208/23] from ovn-kubernetes 36m Normal Completed job/maas-api-revoke-sub-ee526181 Job completed 36m Normal SuccessfulCreate job/maas-api-revoke-sub-240e9cfd Created pod: maas-api-revoke-sub-240e9cfd-tcw8l 36m Normal AddedInterface pod/maas-api-revoke-sub-240e9cfd-tcw8l Add eth0 [10.132.0.209/23] from ovn-kubernetes 36m Normal Started pod/maas-api-revoke-sub-240e9cfd-tcw8l Container started 36m Normal Created pod/maas-api-revoke-sub-240e9cfd-tcw8l Container created 36m Normal Pulled pod/maas-api-revoke-sub-240e9cfd-tcw8l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 36m Normal Completed job/maas-api-revoke-sub-240e9cfd Job completed 35m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-77254d-r5xtk Add eth0 [10.132.0.211/23] from ovn-kubernetes 35m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-77254d-r5xtk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-77254d Created pod: maas-api-revoke-keys-e2e-inf-a-77254d-r5xtk 35m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-77254d-r5xtk Container created 35m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-77254d-r5xtk Container started 35m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-77254d Job completed 35m Normal Killing pod/maas-api-e2e-inf-a-77254d-55f7f48fd6-twrk7 Stopping container maas-api 35m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-ddb271 Created pod: maas-api-revoke-keys-e2e-inf-b-ddb271-f5gd8 35m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-ddb271-f5gd8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 35m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-ddb271-f5gd8 Add eth0 [10.132.0.213/23] from ovn-kubernetes 34m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-ddb271-f5gd8 Container started 34m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-ddb271-f5gd8 Container created 34m Normal SuccessfulCreate job/maas-api-revoke-sub-306f377f Created pod: maas-api-revoke-sub-306f377f-5pqdt 34m Normal AddedInterface pod/maas-api-revoke-sub-306f377f-5pqdt Add eth0 [10.133.0.199/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-306f377f-5pqdt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Created pod/maas-api-revoke-sub-306f377f-5pqdt Container created 34m Normal Started pod/maas-api-revoke-sub-306f377f-5pqdt Container started 34m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-ddb271 Job completed 34m Normal Completed job/maas-api-revoke-sub-306f377f Job completed 34m Normal SuccessfulCreate job/maas-api-revoke-sub-167051bd Created pod: maas-api-revoke-sub-167051bd-vc57w 34m Normal Pulled pod/maas-api-revoke-sub-167051bd-vc57w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Started pod/maas-api-revoke-sub-167051bd-vc57w Container started 34m Normal AddedInterface pod/maas-api-revoke-sub-167051bd-vc57w Add eth0 [10.132.0.215/23] from ovn-kubernetes 34m Normal Created pod/maas-api-revoke-sub-167051bd-vc57w Container created 34m Normal SuccessfulCreate job/maas-api-revoke-sub-40bd9b0b Created pod: maas-api-revoke-sub-40bd9b0b-54kfk 34m Normal AddedInterface pod/maas-api-revoke-sub-40bd9b0b-54kfk Add eth0 [10.133.0.200/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-40bd9b0b-54kfk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Started pod/maas-api-revoke-sub-40bd9b0b-54kfk Container started 34m Normal Completed job/maas-api-revoke-sub-167051bd Job completed 34m Normal Created pod/maas-api-revoke-sub-40bd9b0b-54kfk Container created 34m Normal Completed job/maas-api-revoke-sub-40bd9b0b Job completed 34m Normal SuccessfulCreate job/maas-api-revoke-sub-c90a6f86 Created pod: maas-api-revoke-sub-c90a6f86-hj4rj 34m Normal AddedInterface pod/maas-api-revoke-sub-c90a6f86-hj4rj Add eth0 [10.132.0.216/23] from ovn-kubernetes 34m Normal Created pod/maas-api-revoke-sub-c90a6f86-hj4rj Container created 34m Normal Started pod/maas-api-revoke-sub-c90a6f86-hj4rj Container started 34m Normal Pulled pod/maas-api-revoke-sub-c90a6f86-hj4rj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Completed job/maas-api-revoke-sub-c90a6f86 Job completed 34m Normal AddedInterface pod/maas-api-revoke-sub-99802cce-r8d8r Add eth0 [10.132.0.217/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-99802cce-r8d8r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal SuccessfulCreate job/maas-api-revoke-sub-99802cce Created pod: maas-api-revoke-sub-99802cce-r8d8r 34m Normal Created pod/maas-api-revoke-sub-99802cce-r8d8r Container created 34m Normal Started pod/maas-api-revoke-sub-99802cce-r8d8r Container started 34m Normal SuccessfulCreate job/maas-api-revoke-sub-280238be Created pod: maas-api-revoke-sub-280238be-w76vf 34m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-31721c Created pod: maas-api-revoke-keys-e2e-inf-a-31721c-kcb4z 34m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-31721c-kcb4z Add eth0 [10.133.0.201/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-31721c-kcb4z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Pulled pod/maas-api-revoke-sub-280238be-w76vf Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 34m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-31721c-kcb4z Container created 34m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-31721c-kcb4z Container started 34m Normal AddedInterface pod/maas-api-revoke-sub-280238be-w76vf Add eth0 [10.133.0.202/23] from ovn-kubernetes 34m Normal Created pod/maas-api-revoke-sub-280238be-w76vf Container created 34m Normal Started pod/maas-api-revoke-sub-280238be-w76vf Container started 34m Normal Completed job/maas-api-revoke-sub-99802cce Job completed 34m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-31721c Job completed 34m Normal Completed job/maas-api-revoke-sub-280238be Job completed 34m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-b-ddb271 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-b-ddb271: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-b-ddb271": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-b-ddb271, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5bdd35d8-e115-4f98-b6be-509f50a73cfb, UID in object meta: 34m Normal Killing pod/maas-api-e2e-inf-b-ddb271-676674db6-w4mhq Stopping container maas-api 34m Normal SuccessfulCreate job/maas-api-revoke-sub-0b6092f3 Created pod: maas-api-revoke-sub-0b6092f3-ffr4l 34m Normal AddedInterface pod/maas-api-revoke-sub-0b6092f3-ffr4l Add eth0 [10.132.0.218/23] from ovn-kubernetes 34m Normal Pulled pod/maas-api-revoke-sub-0b6092f3-ffr4l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Killing pod/maas-api-e2e-inf-a-31721c-5b5f798fb8-g5txm Stopping container maas-api 33m Normal Created pod/maas-api-revoke-sub-0b6092f3-ffr4l Container created 33m Normal Started pod/maas-api-revoke-sub-0b6092f3-ffr4l Container started 33m Normal Completed job/maas-api-revoke-sub-0b6092f3 Job completed 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-b5a369-t88s9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-b5a369 Created pod: maas-api-revoke-keys-e2e-inf-a-b5a369-t88s9 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-b5a369-t88s9 Add eth0 [10.132.0.219/23] from ovn-kubernetes 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-b5a369-t88s9 Container started 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-b5a369-t88s9 Container created 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-b5a369 Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-5dd8cc Created pod: maas-api-revoke-keys-e2e-inf-b-5dd8cc-29kf8 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-5dd8cc-29kf8 Add eth0 [10.132.0.220/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-5dd8cc-29kf8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-5dd8cc-29kf8 Container created 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-5dd8cc-29kf8 Container started 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-5dd8cc Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-sub-91e57fb3 Created pod: maas-api-revoke-sub-91e57fb3-94t58 33m Normal Pulled pod/maas-api-revoke-sub-91e57fb3-94t58 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal AddedInterface pod/maas-api-revoke-sub-91e57fb3-94t58 Add eth0 [10.132.0.221/23] from ovn-kubernetes 33m Normal Started pod/maas-api-revoke-sub-91e57fb3-94t58 Container started 33m Normal Created pod/maas-api-revoke-sub-91e57fb3-94t58 Container created 33m Normal Completed job/maas-api-revoke-sub-91e57fb3 Job completed 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-0ad384 Created pod: maas-api-revoke-keys-e2e-inf-a-0ad384-mp6rb 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-0ad384-mp6rb Add eth0 [10.132.0.224/23] from ovn-kubernetes 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-0ad384-mp6rb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-0ad384-mp6rb Container created 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-0ad384-mp6rb Container started 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-0ad384 Job completed 33m Warning Unhealthy pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Readiness probe failed: Get "https://10.134.0.96:8443/health": dial tcp 10.134.0.96:8443: connect: connection refused 33m Normal Killing pod/maas-api-e2e-inf-a-b5a369-75cdb8ddd5-t4sbd Stopping container maas-api 33m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-8467ed Created pod: maas-api-revoke-keys-e2e-inf-b-8467ed-gr9m4 33m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-8467ed-gr9m4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 33m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-8467ed-gr9m4 Container started 33m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-8467ed-gr9m4 Container created 33m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-8467ed-gr9m4 Add eth0 [10.132.0.225/23] from ovn-kubernetes 33m Normal Killing pod/maas-api-e2e-inf-b-5dd8cc-657cd56d9c-wps6v Stopping container maas-api 33m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-8467ed Job completed 32m Normal Killing pod/maas-api-e2e-inf-a-0ad384-9f75b9b47-mgtnx Stopping container maas-api 32m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-09e4c0-fxzmx Add eth0 [10.132.0.231/23] from ovn-kubernetes 32m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-09e4c0 Created pod: maas-api-revoke-keys-e2e-inf-b-09e4c0-fxzmx 32m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-09e4c0-fxzmx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-09e4c0-fxzmx Container started 32m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-09e4c0-fxzmx Container created 32m Normal Pulled pod/maas-api-revoke-sub-63997418-gz4zg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/maas-api-revoke-sub-63997418-gz4zg Add eth0 [10.132.0.232/23] from ovn-kubernetes 32m Normal SuccessfulCreate job/maas-api-revoke-sub-63997418 Created pod: maas-api-revoke-sub-63997418-gz4zg 32m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-09e4c0 Job completed 32m Normal Started pod/maas-api-revoke-sub-63997418-gz4zg Container started 32m Normal Pulled pod/maas-api-revoke-sub-6b97b9de-kvsj7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Created pod/maas-api-revoke-sub-63997418-gz4zg Container created 32m Normal SuccessfulCreate job/maas-api-revoke-sub-6b97b9de Created pod: maas-api-revoke-sub-6b97b9de-kvsj7 32m Normal AddedInterface pod/maas-api-revoke-sub-6b97b9de-kvsj7 Add eth0 [10.133.0.203/23] from ovn-kubernetes 32m Normal Started pod/maas-api-revoke-sub-6b97b9de-kvsj7 Container started 32m Normal Created pod/maas-api-revoke-sub-6b97b9de-kvsj7 Container created 32m Normal Completed job/maas-api-revoke-sub-63997418 Job completed 32m Normal Completed job/maas-api-revoke-sub-6b97b9de Job completed 32m Normal Killing pod/maas-api-e2e-inf-b-8467ed-76766c9c88-cbg5d Stopping container maas-api 32m Normal SuccessfulCreate job/maas-api-revoke-sub-1d25db49 Created pod: maas-api-revoke-sub-1d25db49-xrw2t 32m Normal SuccessfulCreate job/maas-api-revoke-sub-bf6e4f8f Created pod: maas-api-revoke-sub-bf6e4f8f-m65bs 32m Normal Started pod/maas-api-revoke-sub-bf6e4f8f-m65bs Container started 32m Normal Started pod/maas-api-revoke-sub-1d25db49-xrw2t Container started 32m Normal Created pod/maas-api-revoke-sub-1d25db49-xrw2t Container created 32m Normal Pulled pod/maas-api-revoke-sub-1d25db49-xrw2t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal Created pod/maas-api-revoke-sub-bf6e4f8f-m65bs Container created 32m Normal Pulled pod/maas-api-revoke-sub-bf6e4f8f-m65bs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 32m Normal AddedInterface pod/maas-api-revoke-sub-bf6e4f8f-m65bs Add eth0 [10.132.0.235/23] from ovn-kubernetes 32m Normal AddedInterface pod/maas-api-revoke-sub-1d25db49-xrw2t Add eth0 [10.133.0.205/23] from ovn-kubernetes 32m Normal Completed job/maas-api-revoke-sub-bf6e4f8f Job completed 32m Normal Completed job/maas-api-revoke-sub-1d25db49 Job completed 32m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w3-c47903-546d9c8468 Created pod: maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc 32m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w3-c47903 Scaled up replica set maas-api-e2e-shared-a-w3-c47903-546d9c8468 from 0 to 1 32m Normal AddedInterface pod/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc Add eth0 [10.133.0.206/23] from ovn-kubernetes 32m Normal Created pod/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc Container created 32m Normal Started pod/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc Container started 32m Normal Pulled pod/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 341ms (341ms including waiting). Image size: 194510193 bytes. 32m Normal Pulling pod/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-47628d Created pod: maas-api-revoke-keys-e2e-inf-a-47628d-r7v9b 31m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-47628d-r7v9b Container created 31m Normal Killing pod/maas-api-e2e-inf-b-09e4c0-67558bd879-bz95g Stopping container maas-api 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-47628d-r7v9b Add eth0 [10.132.0.236/23] from ovn-kubernetes 31m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-47628d-r7v9b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-inf-b-09e4c0 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-inf-b-09e4c0: Operation cannot be fulfilled on endpoints "maas-api-e2e-inf-b-09e4c0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-inf-b-09e4c0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ab6780b8-d7bd-4491-8eed-efdb3c1fe0c3, UID in object meta: 31m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-47628d-r7v9b Container started 31m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-47628d Job completed 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-a-4651e8 Created pod: maas-api-revoke-keys-e2e-inf-a-4651e8-9j4n2 31m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-a-4651e8-9j4n2 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal Created pod/maas-api-revoke-keys-e2e-inf-a-4651e8-9j4n2 Container created 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-a-4651e8-9j4n2 Add eth0 [10.132.0.237/23] from ovn-kubernetes 31m Normal Started pod/maas-api-revoke-keys-e2e-inf-a-4651e8-9j4n2 Container started 31m Normal Completed job/maas-api-revoke-keys-e2e-inf-a-4651e8 Job completed 31m Normal Killing pod/maas-api-e2e-inf-a-47628d-587b5897c6-d6qpk Stopping container maas-api 31m Normal Killing pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Stopping container maas-api 31m Warning Unhealthy pod/maas-api-e2e-inf-a-4651e8-b6896f56d-xdcst Readiness probe failed: Get "https://10.134.0.104:8443/health": dial tcp 10.134.0.104:8443: connect: connection refused 31m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-5c7ba3-md8hb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 31m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-5c7ba3 Created pod: maas-api-revoke-keys-e2e-inf-b-5c7ba3-md8hb 31m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-5c7ba3-md8hb Add eth0 [10.132.0.243/23] from ovn-kubernetes 31m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-5c7ba3-md8hb Container started 31m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-5c7ba3-md8hb Container created 31m Normal AddedInterface pod/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb Add eth0 [10.132.0.244/23] from ovn-kubernetes 31m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-5c7ba3 Job completed 31m Normal Pulling pod/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 31m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w5-9cbcbc Scaled up replica set maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988 from 0 to 1 31m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988 Created pod: maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb 30m Normal Pulled pod/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 420ms (420ms including waiting). Image size: 194510193 bytes. 30m Normal Started pod/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb Container started 30m Normal Created pod/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb Container created 30m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-inf-b-376c89 Created pod: maas-api-revoke-keys-e2e-inf-b-376c89-hj946 30m Normal Started pod/maas-api-revoke-keys-e2e-inf-b-376c89-hj946 Container started 30m Normal Pulled pod/maas-api-revoke-keys-e2e-inf-b-376c89-hj946 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-keys-e2e-inf-b-376c89-hj946 Add eth0 [10.132.0.245/23] from ovn-kubernetes 30m Normal Created pod/maas-api-revoke-keys-e2e-inf-b-376c89-hj946 Container created 30m Normal Completed job/maas-api-revoke-keys-e2e-inf-b-376c89 Job completed 30m Normal SuccessfulCreate job/maas-api-revoke-sub-b2f4fda1 Created pod: maas-api-revoke-sub-b2f4fda1-z86bn 30m Normal Pulled pod/maas-api-revoke-sub-b2f4fda1-z86bn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal AddedInterface pod/maas-api-revoke-sub-b2f4fda1-z86bn Add eth0 [10.132.0.246/23] from ovn-kubernetes 30m Normal Started pod/maas-api-revoke-sub-b2f4fda1-z86bn Container started 30m Normal Created pod/maas-api-revoke-sub-b2f4fda1-z86bn Container created 30m Normal Completed job/maas-api-revoke-sub-b2f4fda1 Job completed 30m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w3-4b0ea9 Scaled up replica set maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d from 0 to 1 30m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d Created pod: maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg 30m Normal Started pod/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg Container started 30m Normal AddedInterface pod/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg Add eth0 [10.134.0.120/23] from ovn-kubernetes 30m Normal Pulling pod/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 30m Normal Pulled pod/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 339ms (339ms including waiting). Image size: 194510193 bytes. 30m Normal Created pod/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg Container created 30m Normal SuccessfulCreate job/maas-api-revoke-sub-33cbda8b Created pod: maas-api-revoke-sub-33cbda8b-wv8z5 30m Normal AddedInterface pod/maas-api-revoke-sub-33cbda8b-wv8z5 Add eth0 [10.132.0.247/23] from ovn-kubernetes 30m Normal Pulled pod/maas-api-revoke-sub-33cbda8b-wv8z5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-revoke-sub-33cbda8b-wv8z5 Container created 30m Normal Started pod/maas-api-revoke-sub-33cbda8b-wv8z5 Container started 30m Normal Killing pod/maas-api-e2e-inf-b-5c7ba3-574966bcc5-nvlwk Stopping container maas-api 30m Normal Completed job/maas-api-revoke-sub-33cbda8b Job completed 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-f07dfe Created job maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w1-ff4285 Created job maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450 Created pod: maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0 Created job maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w4-b29df4 Created job maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w4-d7e62b Created job maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450 Created pod: maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w3-c47903 Created job maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w3-d833bd Created job maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450 Created pod: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450 Created pod: maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450 Created pod: maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb Add eth0 [10.134.0.121/23] from ovn-kubernetes 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450 Created pod: maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450 Created pod: maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w2-5a6281 Created job maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450 Created pod: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450 Created pod: maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450 Created pod: maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-inf-b-376c89 Created job maas-api-key-cleanup-e2e-inf-b-376c89-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w2-cb58b8 Created job maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-inf-b-376c89-29889450 Created pod: maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450 Created pod: maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9 Created job maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450 Created pod: maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5 Created job maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9 Created job maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450 Created pod: maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-52a649 Created job maas-api-key-cleanup-e2e-worker-w1-52a649-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b Created job maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-ee7d65 Created job maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450 Created pod: maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450 Created pod: maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450 Created pod: maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc Created job maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450 Created pod: maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp 30m Normal SuccessfulCreate job/maas-api-key-cleanup-29889450 Created pod: maas-api-key-cleanup-29889450-t4jnj 30m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450 Created pod: maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-a-w6-9c6033 Created job maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450 30m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-e34fd5 Created job maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 Add eth0 [10.133.0.214/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b Add eth0 [10.132.0.250/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp Add eth0 [10.133.0.213/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk Add eth0 [10.132.0.248/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 Add eth0 [10.133.0.217/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 Add eth0 [10.134.0.123/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 Add eth0 [10.134.0.126/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x Add eth0 [10.132.0.253/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t Add eth0 [10.133.0.212/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh Add eth0 [10.134.0.122/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 Add eth0 [10.132.0.249/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn Add eth0 [10.133.0.215/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 Add eth0 [10.133.0.218/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z Add eth0 [10.132.0.251/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-29889450-t4jnj Add eth0 [10.132.0.252/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd Add eth0 [10.133.0.216/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt Add eth0 [10.132.0.254/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j Add eth0 [10.134.0.124/23] from ovn-kubernetes 30m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk Add eth0 [10.134.0.125/23] from ovn-kubernetes 30m Normal Pulled pod/maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt Container created 30m Normal Killing pod/maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt Stopping container cleanup 30m Normal Started pod/maas-api-key-cleanup-e2e-inf-b-376c89-29889450-dc9wt Container started 30m Normal Killing pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Stopping container maas-api 30m Warning Unhealthy pod/maas-api-e2e-inf-b-376c89-8bd64fb6d-7gdhq Readiness probe failed: Get "https://10.132.0.206:8443/health": dial tcp 10.132.0.206:8443: connect: connection refused 30m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk Container created 30m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk Container started 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb Container started 30m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk Container started 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb Container created 30m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk Container created 30m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp Container created 30m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk_odh-ai-gateway-infra(4b9390be-a2b9-40e5-a70e-29cde5f7c8d2) 30m Normal Created pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 Container created 30m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b Container started 30m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b Container created 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x Container started 30m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x Container created 30m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp Container started 30m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450-zm8xk 30m Normal Started pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 Container started 30m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Pulled pod/maas-api-key-cleanup-29889450-t4jnj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x_odh-ai-gateway-infra(cc49db5d-04ab-4ca6-b0c2-9094909526b2) 30m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 Container started 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp 30m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk_odh-ai-gateway-infra(998f2f9e-5b70-42d1-a7ed-66de6f1c9146) 30m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b_odh-ai-gateway-infra(c4633f32-74bb-4ff0-ba96-7baef8fd130f) 30m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450-f6f8b 30m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 Container created 30m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 30m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j Container created 30m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb 30m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450-tfxfk 30m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450-tfxgb_odh-ai-gateway-infra(d7779049-af76-4965-8838-00e5c1eda794) 30m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j Container started 30m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450-g5qzp_odh-ai-gateway-infra(ace885ec-090f-469d-ba45-23bd11e84d9e) 29m Normal Created pod/maas-api-key-cleanup-29889450-t4jnj Container created 29m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t Container created 29m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t Container started 29m Normal Started pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 Container started 29m Normal Created pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 Container created 29m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh Container started 29m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7_odh-ai-gateway-infra(7943ae21-45c1-466b-a9ff-9bfc8dbfe485) 29m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 Container started 29m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 Container created 29m Normal Started pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z Container started 29m Warning BackOff pod/maas-api-key-cleanup-29889450-t4jnj Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29889450-t4jnj_odh-ai-gateway-infra(8e317c46-94d2-4900-b307-6ac09a1d832d) 29m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh Container created 29m Normal Created pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z Container created 29m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450 Deleted pod: maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 29m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Started pod/maas-api-key-cleanup-29889450-t4jnj Container started 29m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j_odh-ai-gateway-infra(6b7ea0eb-4b45-4168-9df5-2a6591edd74d) 29m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450-9hkp9_odh-ai-gateway-infra(6dd57d65-b68c-48f4-b173-827652241344) 29m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450 Deleted pod: maas-api-key-cleanup-e2e-worker-w1-52a649-29889450-zt62j 29m Normal Started pod/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 Container started 29m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8_odh-ai-gateway-infra(6b3d7096-56e6-4491-a5f1-737dcb106b1d) 29m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn Container created 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450 Job has reached the specified backoff limit 29m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 Container started 29m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 Container created 29m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn Container started 29m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t_odh-ai-gateway-infra(d10daaa5-7cac-4205-8638-75ede670c28f) 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w2-8b77b0 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w2-8b77b0-29889450, condition: Failed 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450-bnh6t 29m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh_odh-ai-gateway-infra(38b1ca04-4bf9-48c5-abe8-644a12a66127) 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450, condition: Failed 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w1-8d82d5-29889450 Job has reached the specified backoff limit 29m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd Container created 29m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd Container started 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w1-ff4285 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w1-ff4285-29889450, condition: Failed 29m Normal Created pod/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 Container created 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc Saw completed job: maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450, condition: Failed 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w5-9cbcbc-29889450 Job has reached the specified backoff limit 29m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z_odh-ai-gateway-infra(978b344c-24b0-4fc2-a8f0-7c72d7510ceb) 29m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468_odh-ai-gateway-infra(ff661c30-4a5a-4a98-b640-3b2c3e4143e1) 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450 Deleted pod: maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450-q6468 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450-cgl2x 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450-ggpn8 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450 Job has reached the specified backoff limit 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450 Deleted pod: maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w1-52a649-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w4-f0a31b Saw completed job: maas-api-key-cleanup-e2e-shared-a-w4-f0a31b-29889450, condition: Failed 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w1-52a649 Saw completed job: maas-api-key-cleanup-e2e-worker-w1-52a649-29889450, condition: Failed 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-e34fd5 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450, condition: Failed 29m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450-589x5_odh-ai-gateway-infra(17dc6af9-2a39-48fe-a3dc-405f9f9f1ea0) 29m Normal SuccessfulDelete job/maas-api-key-cleanup-29889450 Deleted pod: maas-api-key-cleanup-29889450-t4jnj 29m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450-dc8t7_odh-ai-gateway-infra(0fa046ef-c365-47a1-976f-18f12312ea4e) 29m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450-4glnd_odh-ai-gateway-infra(a0239aaa-e1bf-4ad8-bf54-42920cc8009c) 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450 Deleted pod: maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450-wmr7z 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889450 Job has reached the specified backoff limit 29m Warning BackOff pod/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn_odh-ai-gateway-infra(f08ebb94-561c-42b6-9430-3c1d78c5fc8a) 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w4-d7e62b Saw completed job: maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450, condition: Failed 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450-hczp7 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450-hh8hh 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w4-d7e62b-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29889450, condition: Failed 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-ee7d65 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450, condition: Failed 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450 Job has reached the specified backoff limit 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29889450 Job has reached the specified backoff limit 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w2-5a6281 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450, condition: Failed 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889450 Job has reached the specified backoff limit 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450 Job has reached the specified backoff limit 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w2-5a6281-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w3-d833bd Saw completed job: maas-api-key-cleanup-e2e-worker-w3-d833bd-29889450, condition: Failed 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w3-c47903 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w3-c47903-29889450, condition: Failed 29m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450 Deleted pod: maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450-v8kpn 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889450, condition: Failed 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-a-w6-9c6033 Saw completed job: maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450, condition: Failed 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w2-cb58b8 Saw completed job: maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450, condition: Failed 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-a-w6-9c6033-29889450 Job has reached the specified backoff limit 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w2-cb58b8-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w4-b29df4 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450, condition: Failed 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w4-b29df4-29889450 Job has reached the specified backoff limit 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w0-f07dfe Saw completed job: maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889450, condition: Failed 29m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450 Job has reached the specified backoff limit 29m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9 Saw completed job: maas-api-key-cleanup-e2e-shared-b-w3-4b0ea9-29889450, condition: Failed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-275ab4bf Created pod: maas-api-revoke-sub-275ab4bf-vnzdk 29m Normal Pulled pod/maas-api-revoke-sub-275ab4bf-vnzdk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-sub-275ab4bf-vnzdk Container created 29m Normal Started pod/maas-api-revoke-sub-275ab4bf-vnzdk Container started 29m Normal AddedInterface pod/maas-api-revoke-sub-275ab4bf-vnzdk Add eth0 [10.132.1.4/23] from ovn-kubernetes 29m Normal Completed job/maas-api-revoke-sub-275ab4bf Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-12826b2b Created pod: maas-api-revoke-sub-12826b2b-lq4cq 29m Normal Pulled pod/maas-api-revoke-sub-12826b2b-lq4cq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-sub-12826b2b-lq4cq Add eth0 [10.132.1.8/23] from ovn-kubernetes 29m Warning FailedMount pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-b-w5-82796d-serving-cert" not found 29m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w5-82796d-845d757c8f Created pod: maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 29m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w5-82796d Scaled up replica set maas-api-e2e-shared-b-w5-82796d-845d757c8f from 0 to 1 29m Normal Pulling pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 29m Normal AddedInterface pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 Add eth0 [10.132.1.7/23] from ovn-kubernetes 29m Normal Created pod/maas-api-revoke-sub-12826b2b-lq4cq Container created 29m Normal Pulled pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 490ms (490ms including waiting). Image size: 194510193 bytes. 29m Normal Started pod/maas-api-revoke-sub-12826b2b-lq4cq Container started 29m Normal Created pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 Container created 29m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-a-w0-fdd4d4 Scaled up replica set maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5 from 0 to 1 29m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5 Created pod: maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk 29m Normal Pulling pod/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 29m Normal AddedInterface pod/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk Add eth0 [10.134.0.128/23] from ovn-kubernetes 29m Normal Started pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 Container started 29m Normal Pulled pod/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 334ms (334ms including waiting). Image size: 194510193 bytes. 29m Normal Started pod/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk Container started 29m Normal Created pod/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk Container created 29m Normal Completed job/maas-api-revoke-sub-12826b2b Job completed 29m Normal Pulled pod/maas-api-revoke-sub-366b8d90-8npfn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal AddedInterface pod/maas-api-revoke-sub-366b8d90-8npfn Add eth0 [10.132.1.11/23] from ovn-kubernetes 29m Normal SuccessfulCreate job/maas-api-revoke-sub-366b8d90 Created pod: maas-api-revoke-sub-366b8d90-8npfn 29m Normal Created pod/maas-api-revoke-sub-366b8d90-8npfn Container created 29m Normal Started pod/maas-api-revoke-sub-366b8d90-8npfn Container started 29m Normal Completed job/maas-api-revoke-sub-366b8d90 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-8fb64431 Created pod: maas-api-revoke-sub-8fb64431-k2f2c 29m Normal AddedInterface pod/maas-api-revoke-sub-8fb64431-k2f2c Add eth0 [10.132.1.12/23] from ovn-kubernetes 29m Normal Pulled pod/maas-api-revoke-sub-8fb64431-k2f2c Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Created pod/maas-api-revoke-sub-8fb64431-k2f2c Container created 29m Normal Started pod/maas-api-revoke-sub-8fb64431-k2f2c Container started 29m Normal Completed job/maas-api-revoke-sub-8fb64431 Job completed 29m Normal SuccessfulCreate job/maas-api-revoke-sub-6c746f1a Created pod: maas-api-revoke-sub-6c746f1a-rw8wk 29m Normal AddedInterface pod/maas-api-revoke-sub-6c746f1a-rw8wk Add eth0 [10.132.1.14/23] from ovn-kubernetes 29m Normal Created pod/maas-api-revoke-sub-6c746f1a-rw8wk Container created 29m Normal Pulled pod/maas-api-revoke-sub-6c746f1a-rw8wk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 29m Normal Started pod/maas-api-revoke-sub-6c746f1a-rw8wk Container started 28m Normal Completed job/maas-api-revoke-sub-6c746f1a Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-33efb373 Created pod: maas-api-revoke-sub-33efb373-j9whk 28m Normal Pulled pod/maas-api-revoke-sub-33efb373-j9whk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal AddedInterface pod/maas-api-revoke-sub-33efb373-j9whk Add eth0 [10.132.1.15/23] from ovn-kubernetes 28m Normal Started pod/maas-api-revoke-sub-33efb373-j9whk Container started 28m Normal Created pod/maas-api-revoke-sub-33efb373-j9whk Container created 28m Normal Completed job/maas-api-revoke-sub-33efb373 Job completed 28m Normal SuccessfulCreate job/maas-api-revoke-sub-1f443e7c Created pod: maas-api-revoke-sub-1f443e7c-5xbkx 28m Normal AddedInterface pod/maas-api-revoke-sub-1f443e7c-5xbkx Add eth0 [10.132.1.16/23] from ovn-kubernetes 28m Normal Pulled pod/maas-api-revoke-sub-1f443e7c-5xbkx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Created pod/maas-api-revoke-sub-1f443e7c-5xbkx Container created 28m Normal Started pod/maas-api-revoke-sub-1f443e7c-5xbkx Container started 28m Normal Completed job/maas-api-revoke-sub-1f443e7c Job completed 28m Normal AddedInterface pod/maas-api-revoke-sub-7d6ce356-24gfn Add eth0 [10.132.1.19/23] from ovn-kubernetes 28m Normal SuccessfulCreate job/maas-api-revoke-sub-7d6ce356 Created pod: maas-api-revoke-sub-7d6ce356-24gfn 28m Normal Started pod/maas-api-revoke-sub-7d6ce356-24gfn Container started 28m Normal Pulled pod/maas-api-revoke-sub-7d6ce356-24gfn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 28m Normal Created pod/maas-api-revoke-sub-7d6ce356-24gfn Container created 28m Normal Completed job/maas-api-revoke-sub-7d6ce356 Job completed 27m Normal SuccessfulCreate replicaset/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb Created pod: maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm 27m Normal ScalingReplicaSet deployment/maas-api-e2e-shared-b-w0-6da60a Scaled up replica set maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb from 0 to 1 27m Warning FailedMount pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-shared-b-w0-6da60a-serving-cert" not found 27m Normal AddedInterface pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm Add eth0 [10.133.0.227/23] from ovn-kubernetes 27m Normal Pulling pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 27m Normal Pulled pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 484ms (484ms including waiting). Image size: 194510193 bytes. 27m Normal Started pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm Container started 27m Normal Created pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm Container created 26m Normal AddedInterface pod/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg Add eth0 [10.133.0.230/23] from ovn-kubernetes 26m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-082748-8fcd5c46 Created pod: maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg 26m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-082748 Scaled up replica set maas-api-e2e-ipp-a-082748-8fcd5c46 from 0 to 1 26m Normal Pulling pod/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 26m Normal Pulled pod/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 367ms (367ms including waiting). Image size: 194510193 bytes. 26m Normal Started pod/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg Container started 26m Normal Created pod/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg Container created 26m Normal SuccessfulCreate job/maas-api-revoke-sub-07129f75 Created pod: maas-api-revoke-sub-07129f75-fdpkr 26m Normal AddedInterface pod/maas-api-revoke-sub-07129f75-fdpkr Add eth0 [10.132.1.24/23] from ovn-kubernetes 26m Normal Created pod/maas-api-revoke-sub-07129f75-fdpkr Container created 26m Normal Pulled pod/maas-api-revoke-sub-07129f75-fdpkr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Started pod/maas-api-revoke-sub-07129f75-fdpkr Container started 26m Normal Pulled pod/maas-api-revoke-sub-c8ebfa0e-4wzxj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal SuccessfulCreate job/maas-api-revoke-sub-c8ebfa0e Created pod: maas-api-revoke-sub-c8ebfa0e-4wzxj 26m Normal SuccessfulCreate job/maas-api-revoke-sub-30230832 Created pod: maas-api-revoke-sub-30230832-pp4fz 26m Normal AddedInterface pod/maas-api-revoke-sub-c8ebfa0e-4wzxj Add eth0 [10.132.1.25/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-revoke-sub-30230832-pp4fz Add eth0 [10.132.1.26/23] from ovn-kubernetes 26m Normal Created pod/maas-api-revoke-sub-c8ebfa0e-4wzxj Container created 26m Normal Started pod/maas-api-revoke-sub-c8ebfa0e-4wzxj Container started 26m Normal Started pod/maas-api-revoke-sub-30230832-pp4fz Container started 26m Normal Created pod/maas-api-revoke-sub-30230832-pp4fz Container created 26m Normal Pulled pod/maas-api-revoke-sub-30230832-pp4fz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Completed job/maas-api-revoke-sub-07129f75 Job completed 26m Normal Completed job/maas-api-revoke-sub-c8ebfa0e Job completed 26m Normal Completed job/maas-api-revoke-sub-30230832 Job completed 26m Normal SuccessfulCreate job/maas-api-revoke-sub-cbfd24a8 Created pod: maas-api-revoke-sub-cbfd24a8-ft7vw 26m Normal Started pod/maas-api-revoke-sub-cbfd24a8-ft7vw Container started 26m Normal AddedInterface pod/maas-api-revoke-sub-cbfd24a8-ft7vw Add eth0 [10.132.1.27/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-cbfd24a8-ft7vw Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-sub-cbfd24a8-ft7vw Container created 26m Normal SuccessfulCreate job/maas-api-revoke-sub-338efa68 Created pod: maas-api-revoke-sub-338efa68-twqv4 26m Normal SuccessfulCreate job/maas-api-revoke-sub-a75b2a72 Created pod: maas-api-revoke-sub-a75b2a72-gxdpl 26m Normal Pulled pod/maas-api-revoke-sub-338efa68-twqv4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-sub-338efa68-twqv4 Container created 26m Normal Started pod/maas-api-revoke-sub-338efa68-twqv4 Container started 26m Normal AddedInterface pod/maas-api-revoke-sub-338efa68-twqv4 Add eth0 [10.132.1.28/23] from ovn-kubernetes 26m Normal AddedInterface pod/maas-api-revoke-sub-a75b2a72-gxdpl Add eth0 [10.132.1.29/23] from ovn-kubernetes 26m Normal Pulled pod/maas-api-revoke-sub-a75b2a72-gxdpl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 26m Normal Created pod/maas-api-revoke-sub-a75b2a72-gxdpl Container created 26m Normal Started pod/maas-api-revoke-sub-a75b2a72-gxdpl Container started 26m Normal Completed job/maas-api-revoke-sub-cbfd24a8 Job completed 26m Normal Completed job/maas-api-revoke-sub-338efa68 Job completed 26m Normal Completed job/maas-api-revoke-sub-a75b2a72 Job completed 25m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b Created pod: maas-api-revoke-keys-e2e-shared-a-w4-f0a31b-qnlv6 25m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b-qnlv6 Add eth0 [10.132.1.33/23] from ovn-kubernetes 25m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b-qnlv6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 25m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b-qnlv6 Container created 25m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b-qnlv6 Container started 25m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w4-f0a31b Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-6e1ba611 Created pod: maas-api-revoke-sub-6e1ba611-lhppx 24m Normal Created pod/maas-api-revoke-sub-6e1ba611-lhppx Container created 24m Normal Pulled pod/maas-api-revoke-sub-6e1ba611-lhppx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal Started pod/maas-api-revoke-sub-6e1ba611-lhppx Container started 24m Normal AddedInterface pod/maas-api-revoke-sub-6e1ba611-lhppx Add eth0 [10.132.1.40/23] from ovn-kubernetes 24m Normal Completed job/maas-api-revoke-sub-6e1ba611 Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-f33aa610 Created pod: maas-api-revoke-sub-f33aa610-q9jvg 24m Normal AddedInterface pod/maas-api-revoke-sub-f33aa610-q9jvg Add eth0 [10.132.1.41/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-sub-f33aa610-q9jvg Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-428a0e-7555dfcff9 Created pod: maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh 24m Normal Created pod/maas-api-revoke-sub-f33aa610-q9jvg Container created 24m Normal Pulling pod/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 24m Normal Started pod/maas-api-revoke-sub-f33aa610-q9jvg Container started 24m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-428a0e Scaled up replica set maas-api-e2e-ipp-a-428a0e-7555dfcff9 from 0 to 1 24m Normal AddedInterface pod/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh Add eth0 [10.132.1.42/23] from ovn-kubernetes 24m Normal Started pod/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh Container started 24m Normal Created pod/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh Container created 24m Normal Pulled pod/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 368ms (368ms including waiting). Image size: 194510193 bytes. 24m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-b4fb25 Scaled up replica set maas-api-e2e-ipp-a-b4fb25-d94b54998 from 0 to 1 24m Warning FailedMount pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-a-b4fb25-serving-cert" not found 24m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-b4fb25-d94b54998 Created pod: maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w 24m Normal Pulling pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 24m Normal AddedInterface pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w Add eth0 [10.132.1.43/23] from ovn-kubernetes 24m Normal Started pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w Container started 24m Normal Pulled pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 309ms (309ms including waiting). Image size: 194510193 bytes. 24m Normal Created pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w Container created 24m Normal Completed job/maas-api-revoke-sub-f33aa610 Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-aef9da70 Created pod: maas-api-revoke-sub-aef9da70-g22n9 24m Normal AddedInterface pod/maas-api-revoke-sub-aef9da70-g22n9 Add eth0 [10.132.1.44/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-sub-aef9da70-g22n9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal Created pod/maas-api-revoke-sub-aef9da70-g22n9 Container created 24m Normal Started pod/maas-api-revoke-sub-aef9da70-g22n9 Container started 24m Normal Killing pod/maas-api-e2e-shared-a-w4-f0a31b-7847747b5b-n9mx4 Stopping container maas-api 24m Normal Completed job/maas-api-revoke-sub-aef9da70 Job completed 24m Normal SuccessfulCreate job/maas-api-revoke-sub-fa3bb89b Created pod: maas-api-revoke-sub-fa3bb89b-hsh7l 24m Normal AddedInterface pod/maas-api-revoke-sub-fa3bb89b-hsh7l Add eth0 [10.132.1.45/23] from ovn-kubernetes 24m Normal Pulled pod/maas-api-revoke-sub-fa3bb89b-hsh7l Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal Created pod/maas-api-revoke-sub-fa3bb89b-hsh7l Container created 24m Normal Started pod/maas-api-revoke-sub-fa3bb89b-hsh7l Container started 24m Normal Completed job/maas-api-revoke-sub-fa3bb89b Job completed 24m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w4-b29df4-zn94s Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 24m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w4-b29df4-zn94s Add eth0 [10.132.1.46/23] from ovn-kubernetes 24m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w4-b29df4 Created pod: maas-api-revoke-keys-e2e-shared-b-w4-b29df4-zn94s 24m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w4-b29df4-zn94s Container created 24m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w4-b29df4-zn94s Container started 24m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w4-b29df4 Job completed 24m Normal AddedInterface pod/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj Add eth0 [10.134.0.147/23] from ovn-kubernetes 24m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-2b254d-6cc74c694c Created pod: maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj 24m Normal Pulling pod/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 24m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-2b254d Scaled up replica set maas-api-e2e-ipp-b-2b254d-6cc74c694c from 0 to 1 24m Normal Started pod/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj Container started 24m Normal Created pod/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj Container created 24m Normal Pulled pod/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 442ms (442ms including waiting). Image size: 194510193 bytes. 24m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-cf3c79-7846779cd Created pod: maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz 24m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-cf3c79 Scaled up replica set maas-api-e2e-ipp-a-cf3c79-7846779cd from 0 to 1 24m Normal Pulled pod/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 522ms (522ms including waiting). Image size: 194510193 bytes. 24m Normal Pulling pod/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 24m Normal AddedInterface pod/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz Add eth0 [10.133.0.239/23] from ovn-kubernetes 24m Normal Started pod/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz Container started 24m Normal Created pod/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz Container created 23m Warning Unhealthy pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Readiness probe failed: Get "https://10.134.0.80:8443/health": dial tcp 10.134.0.80:8443: connect: connection refused 23m Normal Killing pod/maas-api-e2e-shared-b-w4-b29df4-86bb6fd959-fpbjz Stopping container maas-api 23m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-b-w4-b29df4 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-b29df4: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-b-w4-b29df4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-b29df4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: faa3d536-2b45-4df7-996a-3b9bec8117a7, UID in object meta: 23m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w4-d7e62b Created pod: maas-api-revoke-keys-e2e-worker-w4-d7e62b-cqrsk 23m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w4-d7e62b-cqrsk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 23m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w4-d7e62b-cqrsk Add eth0 [10.132.1.49/23] from ovn-kubernetes 23m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-a8d3b8 Scaled up replica set maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc from 0 to 1 23m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc Created pod: maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 23m Normal Started pod/maas-api-revoke-keys-e2e-worker-w4-d7e62b-cqrsk Container started 23m Normal Created pod/maas-api-revoke-keys-e2e-worker-w4-d7e62b-cqrsk Container created 23m Normal Pulling pod/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 23m Normal Started pod/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 Container started 23m Normal Created pod/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 Container created 23m Normal Pulled pod/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 485ms (485ms including waiting). Image size: 194510193 bytes. 23m Normal AddedInterface pod/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 Add eth0 [10.133.0.243/23] from ovn-kubernetes 23m Normal Completed job/maas-api-revoke-keys-e2e-worker-w4-d7e62b Job completed 23m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-a-78dc89-797f8b64d4 Created pod: maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg 23m Warning FailedMount pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-a-78dc89-serving-cert" not found 23m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-a-78dc89 Scaled up replica set maas-api-e2e-ipp-a-78dc89-797f8b64d4 from 0 to 1 22m Normal AddedInterface pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg Add eth0 [10.133.0.244/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 398ms (398ms including waiting). Image size: 194510193 bytes. 22m Normal Created pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg Container created 22m Normal Started pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg Container started 22m Normal Pulling pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 22m Normal SuccessfulCreate job/maas-api-revoke-sub-e38f94b4 Created pod: maas-api-revoke-sub-e38f94b4-zv8t4 22m Normal SuccessfulCreate job/maas-api-revoke-sub-edb5ea26 Created pod: maas-api-revoke-sub-edb5ea26-2mxrh 22m Normal AddedInterface pod/maas-api-revoke-sub-edb5ea26-2mxrh Add eth0 [10.132.1.53/23] from ovn-kubernetes 22m Normal Started pod/maas-api-revoke-sub-e38f94b4-zv8t4 Container started 22m Normal Pulled pod/maas-api-revoke-sub-edb5ea26-2mxrh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Started pod/maas-api-revoke-sub-edb5ea26-2mxrh Container started 22m Normal Created pod/maas-api-revoke-sub-edb5ea26-2mxrh Container created 22m Normal AddedInterface pod/maas-api-revoke-sub-e38f94b4-zv8t4 Add eth0 [10.132.1.54/23] from ovn-kubernetes 22m Normal Pulled pod/maas-api-revoke-sub-e38f94b4-zv8t4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 22m Normal Created pod/maas-api-revoke-sub-e38f94b4-zv8t4 Container created 22m Normal Completed job/maas-api-revoke-sub-edb5ea26 Job completed 22m Normal Completed job/maas-api-revoke-sub-e38f94b4 Job completed 21m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-082748-mzpq8 Add eth0 [10.132.1.55/23] from ovn-kubernetes 21m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-082748 Created pod: maas-api-revoke-keys-e2e-ipp-a-082748-mzpq8 21m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-082748-mzpq8 Container created 21m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-082748-mzpq8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-082748-mzpq8 Container started 21m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-082748 Job completed 21m Normal Killing pod/maas-api-e2e-ipp-a-082748-8fcd5c46-zpgwg Stopping container maas-api 21m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ipp-a-082748 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ipp-a-082748: Operation cannot be fulfilled on endpoints "maas-api-e2e-ipp-a-082748": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ipp-a-082748, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5af5b24c-91bd-446b-b0ef-ac9ff2922f2c, UID in object meta: 21m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-c54f0f Scaled up replica set maas-api-e2e-ipp-b-c54f0f-5d446cb49d from 0 to 1 21m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-c54f0f-5d446cb49d Created pod: maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks 21m Normal Pulling pod/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 21m Normal Created pod/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks Container created 21m Normal Pulled pod/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 329ms (329ms including waiting). Image size: 194510193 bytes. 21m Normal Started pod/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks Container started 21m Normal AddedInterface pod/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks Add eth0 [10.133.0.251/23] from ovn-kubernetes 21m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-fca422-767b78c8cb Created pod: maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 21m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-fca422 Scaled up replica set maas-api-e2e-ipp-b-fca422-767b78c8cb from 0 to 1 21m Normal Pulling pod/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 21m Normal AddedInterface pod/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 Add eth0 [10.133.0.252/23] from ovn-kubernetes 21m Normal Started pod/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 Container started 21m Normal Created pod/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 Container created 21m Normal Pulled pod/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 375ms (375ms including waiting). Image size: 194510193 bytes. 21m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-2b254d Created pod: maas-api-revoke-keys-e2e-ipp-b-2b254d-lrp84 21m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-2b254d-lrp84 Container created 21m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-2b254d-lrp84 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-2b254d-lrp84 Add eth0 [10.132.1.56/23] from ovn-kubernetes 21m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-2b254d-lrp84 Container started 21m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-2b254d Job completed 21m Normal Killing pod/maas-api-e2e-worker-w4-d7e62b-5879646646-s6fxr Stopping container maas-api 21m Normal Killing pod/maas-api-e2e-ipp-b-2b254d-6cc74c694c-gpqnj Stopping container maas-api 21m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ipp-b-2b254d Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ipp-b-2b254d: Operation cannot be fulfilled on endpoints "maas-api-e2e-ipp-b-2b254d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ipp-b-2b254d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3e92dd4b-faa2-4f85-a4b0-15f7f7663ed7, UID in object meta: 21m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0 Created pod: maas-api-revoke-keys-e2e-shared-a-w2-8b77b0-544n7 21m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0-544n7 Add eth0 [10.132.1.58/23] from ovn-kubernetes 21m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0-544n7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 21m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0-544n7 Container created 21m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0-544n7 Container started 21m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w2-8b77b0 Job completed 20m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-30c004 Scaled up replica set maas-api-e2e-ipp-b-30c004-6f9cbc6566 from 0 to 1 20m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-30c004-6f9cbc6566 Created pod: maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr 20m Warning FailedMount pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-b-30c004-serving-cert" not found 20m Normal Started pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr Container started 20m Normal Pulled pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 591ms (591ms including waiting). Image size: 194510193 bytes. 20m Normal Created pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr Container created 20m Normal AddedInterface pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr Add eth0 [10.133.0.253/23] from ovn-kubernetes 20m Normal Pulling pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 20m Normal Killing pod/maas-api-e2e-shared-a-w2-8b77b0-5f7b7ff96f-wggzj Stopping container maas-api 20m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w2-5a6281 Created pod: maas-api-revoke-keys-e2e-shared-b-w2-5a6281-mdj69 20m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w2-5a6281-mdj69 Add eth0 [10.132.1.64/23] from ovn-kubernetes 20m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w2-5a6281-mdj69 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 20m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w2-5a6281-mdj69 Container created 20m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w2-5a6281-mdj69 Container started 20m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w2-5a6281 Job completed 20m Warning FailedMount pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d MountVolume.SetUp failed for volume "maas-api-tls" : secret "maas-api-e2e-ipp-b-e3ebf5-serving-cert" not found 20m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-e3ebf5 Scaled up replica set maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4 from 0 to 1 20m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4 Created pod: maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d 20m Normal Pulling pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 20m Normal AddedInterface pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d Add eth0 [10.133.0.255/23] from ovn-kubernetes 20m Normal Started pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d Container started 20m Normal Created pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d Container created 20m Normal Pulled pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 470ms (470ms including waiting). Image size: 194510193 bytes. 19m Normal SuccessfulCreate replicaset/maas-api-e2e-ipp-b-8ee35e-6968f44cd7 Created pod: maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 19m Normal ScalingReplicaSet deployment/maas-api-e2e-ipp-b-8ee35e Scaled up replica set maas-api-e2e-ipp-b-8ee35e-6968f44cd7 from 0 to 1 19m Normal Pulling pod/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 19m Normal AddedInterface pod/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 Add eth0 [10.133.1.0/23] from ovn-kubernetes 19m Normal Started pod/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 Container started 19m Normal Created pod/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 Container created 19m Normal Pulled pod/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 283ms (283ms including waiting). Image size: 194510193 bytes. 19m Normal Killing pod/maas-api-e2e-shared-b-w2-5a6281-6bbb86d67-pbbtp Stopping container maas-api 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-428a0e Created pod: maas-api-revoke-keys-e2e-ipp-a-428a0e-m9f5r 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-428a0e-m9f5r Add eth0 [10.132.1.66/23] from ovn-kubernetes 19m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-428a0e-m9f5r Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-428a0e-m9f5r Container created 19m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-428a0e-m9f5r Container started 19m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w2-cb58b8 Created pod: maas-api-revoke-keys-e2e-worker-w2-cb58b8-8pnwt 19m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-428a0e Job completed 19m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w2-cb58b8-8pnwt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 19m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w2-cb58b8-8pnwt Add eth0 [10.132.1.67/23] from ovn-kubernetes 19m Normal Started pod/maas-api-revoke-keys-e2e-worker-w2-cb58b8-8pnwt Container started 19m Normal Created pod/maas-api-revoke-keys-e2e-worker-w2-cb58b8-8pnwt Container created 19m Normal Completed job/maas-api-revoke-keys-e2e-worker-w2-cb58b8 Job completed 19m Normal Killing pod/maas-api-e2e-ipp-a-428a0e-7555dfcff9-n9lsh Stopping container maas-api 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-c54f0f Created pod: maas-api-revoke-keys-e2e-ipp-b-c54f0f-4l8q6 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-c54f0f-4l8q6 Add eth0 [10.132.1.70/23] from ovn-kubernetes 18m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-c54f0f-4l8q6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-c54f0f-4l8q6 Container created 18m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-c54f0f-4l8q6 Container started 18m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-c54f0f Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-sub-b34582ea Created pod: maas-api-revoke-sub-b34582ea-srgl7 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-cf3c79 Created pod: maas-api-revoke-keys-e2e-ipp-a-cf3c79-l9x4v 18m Normal SuccessfulCreate job/maas-api-revoke-sub-56eadae9 Created pod: maas-api-revoke-sub-56eadae9-mw8xx 18m Normal Pulled pod/maas-api-revoke-sub-56eadae9-mw8xx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-cf3c79-l9x4v Add eth0 [10.132.1.73/23] from ovn-kubernetes 18m Normal Started pod/maas-api-revoke-sub-56eadae9-mw8xx Container started 18m Normal Created pod/maas-api-revoke-sub-56eadae9-mw8xx Container created 18m Normal AddedInterface pod/maas-api-revoke-sub-56eadae9-mw8xx Add eth0 [10.132.1.71/23] from ovn-kubernetes 18m Normal Created pod/maas-api-revoke-sub-b34582ea-srgl7 Container created 18m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-cf3c79-l9x4v Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Started pod/maas-api-revoke-sub-b34582ea-srgl7 Container started 18m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-b4fb25 Created pod: maas-api-revoke-keys-e2e-ipp-a-b4fb25-7mxkj 18m Normal AddedInterface pod/maas-api-revoke-sub-b34582ea-srgl7 Add eth0 [10.132.1.72/23] from ovn-kubernetes 18m Normal Pulled pod/maas-api-revoke-sub-b34582ea-srgl7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-b4fb25-7mxkj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-cf3c79-l9x4v Container started 18m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-b4fb25-7mxkj Container started 18m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-b4fb25-7mxkj Container created 18m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-cf3c79-l9x4v Container created 18m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-b4fb25-7mxkj Add eth0 [10.132.1.74/23] from ovn-kubernetes 18m Normal Completed job/maas-api-revoke-sub-56eadae9 Job completed 18m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-cf3c79 Job completed 18m Normal Completed job/maas-api-revoke-sub-b34582ea Job completed 18m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-b4fb25 Job completed 18m Normal SuccessfulCreate job/maas-api-revoke-sub-1b28ef90 Created pod: maas-api-revoke-sub-1b28ef90-558g5 18m Normal Started pod/maas-api-revoke-sub-1b28ef90-558g5 Container started 18m Normal Pulled pod/maas-api-revoke-sub-1b28ef90-558g5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 18m Normal AddedInterface pod/maas-api-revoke-sub-1b28ef90-558g5 Add eth0 [10.132.1.78/23] from ovn-kubernetes 18m Normal Created pod/maas-api-revoke-sub-1b28ef90-558g5 Container created 18m Normal Completed job/maas-api-revoke-sub-1b28ef90 Job completed 17m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-a8d3b8-nvmfk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-a8d3b8 Created pod: maas-api-revoke-keys-e2e-ipp-a-a8d3b8-nvmfk 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-a8d3b8-nvmfk Add eth0 [10.132.1.81/23] from ovn-kubernetes 17m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-a8d3b8-nvmfk Container started 17m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-a8d3b8-nvmfk Container created 17m Normal Killing pod/maas-api-e2e-ipp-b-c54f0f-5d446cb49d-dhfks Stopping container maas-api 17m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-a8d3b8 Job completed 17m Normal Killing pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Stopping container maas-api 17m Warning Unhealthy pod/maas-api-e2e-worker-w2-cb58b8-c59c75f88-smph7 Readiness probe failed: Get "https://10.134.0.34:8443/health": dial tcp 10.134.0.34:8443: connect: connection refused 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w3-c47903 Created pod: maas-api-revoke-keys-e2e-shared-a-w3-c47903-rhgrn 17m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w3-c47903-rhgrn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Killing pod/maas-api-e2e-ipp-a-a8d3b8-7f9bfff7bc-hszb2 Stopping container maas-api 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w3-c47903-rhgrn Add eth0 [10.132.1.82/23] from ovn-kubernetes 17m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w3-c47903-rhgrn Container created 17m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-a-78dc89-95gtz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-a-78dc89 Created pod: maas-api-revoke-keys-e2e-ipp-a-78dc89-95gtz 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-a-78dc89-95gtz Add eth0 [10.132.1.83/23] from ovn-kubernetes 17m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w3-c47903-rhgrn Container started 17m Normal Created pod/maas-api-revoke-keys-e2e-ipp-a-78dc89-95gtz Container created 17m Normal Started pod/maas-api-revoke-keys-e2e-ipp-a-78dc89-95gtz Container started 17m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w3-c47903 Job completed 17m Normal Killing pod/maas-api-e2e-ipp-a-cf3c79-7846779cd-pmvpz Stopping container maas-api 17m Normal Completed job/maas-api-revoke-keys-e2e-ipp-a-78dc89 Job completed 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-e3ebf5 Created pod: maas-api-revoke-keys-e2e-ipp-b-e3ebf5-tv8h8 17m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-e3ebf5-tv8h8 Container created 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-e3ebf5-tv8h8 Add eth0 [10.132.1.84/23] from ovn-kubernetes 17m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-e3ebf5-tv8h8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-e3ebf5-tv8h8 Container started 17m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-e3ebf5 Job completed 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-30c004 Created pod: maas-api-revoke-keys-e2e-ipp-b-30c004-mgxjc 17m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-30c004-mgxjc Container created 17m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-30c004-mgxjc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-30c004-mgxjc Container started 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-30c004-mgxjc Add eth0 [10.132.1.85/23] from ovn-kubernetes 17m Normal Killing pod/maas-api-e2e-ipp-a-78dc89-797f8b64d4-rw7rg Stopping container maas-api 17m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-30c004 Job completed 17m Normal Killing pod/maas-api-e2e-ipp-a-b4fb25-d94b54998-sl99w Stopping container maas-api 17m Warning FailedToUpdateEndpointSlices service/maas-api-e2e-ipp-a-b4fb25 Error updating Endpoint Slices for Service odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4fb25: failed to update maas-api-e2e-ipp-a-b4fb25-fhvxp EndpointSlice for Service odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4fb25: endpointslices.discovery.k8s.io "maas-api-e2e-ipp-a-b4fb25-fhvxp" not found 17m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-8ee35e-7jhwc Add eth0 [10.132.1.86/23] from ovn-kubernetes 17m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-8ee35e-7jhwc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 17m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-8ee35e Created pod: maas-api-revoke-keys-e2e-ipp-b-8ee35e-7jhwc 17m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-8ee35e-7jhwc Container started 17m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-8ee35e-7jhwc Container created 17m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-8ee35e Job completed 16m Normal Killing pod/maas-api-e2e-shared-a-w3-c47903-546d9c8468-kwdcc Stopping container maas-api 16m Normal Killing pod/maas-api-e2e-ipp-b-e3ebf5-76b5bd46b4-8ll5d Stopping container maas-api 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9 Created pod: maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9-g4j9j 16m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9-g4j9j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9-g4j9j Add eth0 [10.132.1.87/23] from ovn-kubernetes 16m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9-g4j9j Container started 16m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9-g4j9j Container created 16m Normal Killing pod/maas-api-e2e-ipp-b-30c004-6f9cbc6566-9j5jr Stopping container maas-api 16m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-ipp-b-30c004 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-ipp-b-30c004: Operation cannot be fulfilled on endpoints "maas-api-e2e-ipp-b-30c004": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-ipp-b-30c004, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 25cb11cf-5b99-4b5b-a76e-b510c2d4c93b, UID in object meta: 16m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w3-4b0ea9 Job completed 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc Created pod: maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc-lcmw9 16m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc-lcmw9 Container started 16m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc-lcmw9 Container created 16m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc-lcmw9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc-lcmw9 Add eth0 [10.132.1.88/23] from ovn-kubernetes 16m Normal Killing pod/maas-api-e2e-ipp-b-8ee35e-6968f44cd7-7xvp8 Stopping container maas-api 16m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w5-9cbcbc Job completed 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4-zx7h5 Add eth0 [10.132.1.89/23] from ovn-kubernetes 16m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4-zx7h5 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4 Created pod: maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4-zx7h5 16m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4-zx7h5 Container created 16m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4-zx7h5 Container started 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w1-ff4285 Created pod: maas-api-revoke-keys-e2e-shared-a-w1-ff4285-6pwfh 16m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w0-fdd4d4 Job completed 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w1-ff4285-6pwfh Add eth0 [10.132.1.90/23] from ovn-kubernetes 16m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w1-ff4285-6pwfh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-ipp-b-fca422 Created pod: maas-api-revoke-keys-e2e-ipp-b-fca422-d62rb 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-ipp-b-fca422-d62rb Add eth0 [10.132.1.91/23] from ovn-kubernetes 16m Normal Pulled pod/maas-api-revoke-keys-e2e-ipp-b-fca422-d62rb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w1-ff4285-6pwfh Container created 16m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w1-ff4285-6pwfh Container started 16m Normal Created pod/maas-api-revoke-keys-e2e-ipp-b-fca422-d62rb Container created 16m Normal Started pod/maas-api-revoke-keys-e2e-ipp-b-fca422-d62rb Container started 16m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w1-ff4285 Job completed 16m Normal Completed job/maas-api-revoke-keys-e2e-ipp-b-fca422 Job completed 16m Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-shared-b-w3-4b0ea9 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4b0ea9: Operation cannot be fulfilled on endpoints "maas-api-e2e-shared-b-w3-4b0ea9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4b0ea9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 41bc0026-9350-4027-997a-e827dbd3e178, UID in object meta: 16m Normal Killing pod/maas-api-e2e-shared-b-w3-4b0ea9-797fc7f4d-j9qvg Stopping container maas-api 16m Normal Killing pod/maas-api-e2e-shared-a-w5-9cbcbc-86cbd4f988-6zdcb Stopping container maas-api 16m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w3-d833bd-wb2zc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w3-d833bd-wb2zc Add eth0 [10.132.1.92/23] from ovn-kubernetes 16m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w3-d833bd Created pod: maas-api-revoke-keys-e2e-worker-w3-d833bd-wb2zc 16m Normal Created pod/maas-api-revoke-keys-e2e-worker-w3-d833bd-wb2zc Container created 16m Normal Started pod/maas-api-revoke-keys-e2e-worker-w3-d833bd-wb2zc Container started 16m Normal Killing pod/maas-api-e2e-ipp-b-fca422-767b78c8cb-fzvl2 Stopping container maas-api 16m Normal Completed job/maas-api-revoke-keys-e2e-worker-w3-d833bd Job completed 16m Normal Killing pod/maas-api-e2e-shared-a-w0-fdd4d4-6c5cf7c8c5-cxbsk Stopping container maas-api 15m Normal Killing pod/maas-api-e2e-shared-a-w1-ff4285-76c67bfb9c-ckgmb Stopping container maas-api 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w5-82796d Created pod: maas-api-revoke-keys-e2e-shared-b-w5-82796d-lthsc 15m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w5-82796d-lthsc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w5-82796d-lthsc Add eth0 [10.132.1.93/23] from ovn-kubernetes 15m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w5-82796d-lthsc Container started 15m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w5-82796d-lthsc Container created 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-a-w6-9c6033 Created pod: maas-api-revoke-keys-e2e-shared-a-w6-9c6033-2wsjv 15m Normal Started pod/maas-api-revoke-keys-e2e-shared-a-w6-9c6033-2wsjv Container started 15m Normal Created pod/maas-api-revoke-keys-e2e-shared-a-w6-9c6033-2wsjv Container created 15m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-a-w6-9c6033-2wsjv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w5-82796d Job completed 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-a-w6-9c6033-2wsjv Add eth0 [10.132.1.94/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w0-6da60a Created pod: maas-api-revoke-keys-e2e-shared-b-w0-6da60a-97mnb 15m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w0-6da60a-97mnb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w0-6da60a-97mnb Add eth0 [10.132.1.95/23] from ovn-kubernetes 15m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w0-6da60a-97mnb Container created 15m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w0-6da60a-97mnb Container started 15m Normal Completed job/maas-api-revoke-keys-e2e-shared-a-w6-9c6033 Job completed 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5 Created pod: maas-api-revoke-keys-e2e-shared-b-w1-8d82d5-zmdk4 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5-zmdk4 Add eth0 [10.132.1.96/23] from ovn-kubernetes 15m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w0-6da60a Job completed 15m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5-zmdk4 Container created 15m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5-zmdk4 Container started 15m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5-zmdk4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal SuccessfulCreate job/maas-api-revoke-sub-d0f26a78 Created pod: maas-api-revoke-sub-d0f26a78-27pzs 15m Normal SuccessfulCreate job/maas-api-revoke-sub-1c2c6ae4 Created pod: maas-api-revoke-sub-1c2c6ae4-4ktfd 15m Normal Created pod/maas-api-revoke-sub-d0f26a78-27pzs Container created 15m Normal Started pod/maas-api-revoke-sub-d0f26a78-27pzs Container started 15m Normal Pulled pod/maas-api-revoke-sub-1c2c6ae4-4ktfd Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-sub-1c2c6ae4-4ktfd Add eth0 [10.132.1.97/23] from ovn-kubernetes 15m Normal Started pod/maas-api-revoke-sub-1c2c6ae4-4ktfd Container started 15m Normal AddedInterface pod/maas-api-revoke-sub-d0f26a78-27pzs Add eth0 [10.132.1.98/23] from ovn-kubernetes 15m Normal Pulled pod/maas-api-revoke-sub-d0f26a78-27pzs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-revoke-sub-1c2c6ae4-4ktfd Container created 15m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w1-8d82d5 Job completed 15m Normal Killing pod/maas-api-e2e-shared-a-w6-9c6033-79d5f6db55-4v7xp Stopping container maas-api 15m Normal Killing pod/maas-api-e2e-shared-b-w5-82796d-845d757c8f-kzs48 Stopping container maas-api 15m Normal Completed job/maas-api-revoke-sub-d0f26a78 Job completed 15m Normal Completed job/maas-api-revoke-sub-1c2c6ae4 Job completed 15m Normal Killing pod/maas-api-e2e-shared-b-w0-6da60a-589f9f6ddb-vcldm Stopping container maas-api 15m Normal Killing pod/maas-api-e2e-shared-b-w1-8d82d5-65c88b865b-xt6lk Stopping container maas-api 15m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w5-e34fd5-xr5jq Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w5-e34fd5-xr5jq Add eth0 [10.132.1.99/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w5-e34fd5 Created pod: maas-api-revoke-keys-e2e-worker-w5-e34fd5-xr5jq 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9 Created pod: maas-api-revoke-keys-e2e-shared-b-w6-cda0d9-pb8r8 15m Normal Pulled pod/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9-pb8r8 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-revoke-keys-e2e-worker-w5-e34fd5-xr5jq Container created 15m Normal Started pod/maas-api-revoke-keys-e2e-worker-w5-e34fd5-xr5jq Container started 15m Normal Started pod/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9-pb8r8 Container started 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9-pb8r8 Add eth0 [10.132.1.100/23] from ovn-kubernetes 15m Normal Created pod/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9-pb8r8 Container created 15m Normal Killing pod/maas-api-e2e-worker-w3-d833bd-5cf45d8d99-8jl44 Stopping container maas-api 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w0-f07dfe Created pod: maas-api-revoke-keys-e2e-worker-w0-f07dfe-bbj94 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w0-f07dfe-bbj94 Add eth0 [10.133.1.3/23] from ovn-kubernetes 15m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w0-f07dfe-bbj94 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Completed job/maas-api-revoke-keys-e2e-worker-w5-e34fd5 Job completed 15m Normal Created pod/maas-api-revoke-keys-e2e-worker-w0-f07dfe-bbj94 Container created 15m Normal Started pod/maas-api-revoke-keys-e2e-worker-w0-f07dfe-bbj94 Container started 15m Normal Completed job/maas-api-revoke-keys-e2e-shared-b-w6-cda0d9 Job completed 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w1-52a649 Created pod: maas-api-revoke-keys-e2e-worker-w1-52a649-jn2jp 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w1-52a649-jn2jp Add eth0 [10.132.1.101/23] from ovn-kubernetes 15m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w1-52a649-jn2jp Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Started pod/maas-api-revoke-keys-e2e-worker-w1-52a649-jn2jp Container started 15m Normal Created pod/maas-api-revoke-keys-e2e-worker-w1-52a649-jn2jp Container created 15m Normal Completed job/maas-api-revoke-keys-e2e-worker-w0-f07dfe Job completed 15m Normal Completed job/maas-api-revoke-keys-e2e-worker-w1-52a649 Job completed 15m Normal SuccessfulCreate job/maas-api-revoke-sub-2f86e315 Created pod: maas-api-revoke-sub-2f86e315-sxk99 15m Normal SuccessfulCreate job/maas-api-revoke-sub-e168c9e7 Created pod: maas-api-revoke-sub-e168c9e7-pcwgs 15m Normal AddedInterface pod/maas-api-revoke-sub-e168c9e7-pcwgs Add eth0 [10.132.1.102/23] from ovn-kubernetes 15m Normal AddedInterface pod/maas-api-revoke-sub-2f86e315-sxk99 Add eth0 [10.133.1.4/23] from ovn-kubernetes 15m Normal Started pod/maas-api-revoke-sub-e168c9e7-pcwgs Container started 15m Normal Created pod/maas-api-revoke-sub-e168c9e7-pcwgs Container created 15m Normal Pulled pod/maas-api-revoke-sub-2f86e315-sxk99 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-revoke-sub-2f86e315-sxk99 Container created 15m Normal Started pod/maas-api-revoke-sub-2f86e315-sxk99 Container started 15m Normal Pulled pod/maas-api-revoke-sub-e168c9e7-pcwgs Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465 Created pod: maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 15m Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29889465 15m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w1-52a649 Created job maas-api-key-cleanup-e2e-worker-w1-52a649-29889465 15m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w5-e34fd5 Created job maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465 15m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465 Created pod: maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 15m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 Add eth0 [10.133.1.7/23] from ovn-kubernetes 15m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9 Created job maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465 15m Normal SuccessfulCreate job/maas-api-key-cleanup-29889465 Created pod: maas-api-key-cleanup-29889465-r87lk 15m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w0-f07dfe Created job maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465 15m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 Add eth0 [10.132.1.103/23] from ovn-kubernetes 15m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr Add eth0 [10.133.1.6/23] from ovn-kubernetes 15m Normal AddedInterface pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl Add eth0 [10.132.1.104/23] from ovn-kubernetes 15m Normal AddedInterface pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln Add eth0 [10.132.1.105/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465 Created pod: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr 15m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465 Created pod: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln 15m Normal SuccessfulCreate job/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465 Created pod: maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl 15m Normal AddedInterface pod/maas-api-key-cleanup-29889465-r87lk Add eth0 [10.133.1.5/23] from ovn-kubernetes 15m Normal SuccessfulCreate cronjob/maas-api-key-cleanup-e2e-worker-w6-ee7d65 Created job maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465 15m Normal Completed job/maas-api-revoke-sub-2f86e315 Job completed 15m Normal Started pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl Container started 15m Normal Created pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl Container created 15m Normal Pulled pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Started pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 Container started 15m Normal Killing pod/maas-api-e2e-shared-b-w6-cda0d9-57bc7fddf5-gwkvw Stopping container maas-api 15m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 Container created 15m Normal AddedInterface pod/maas-api-revoke-sub-4ac3bc12-jlntx Add eth0 [10.132.1.106/23] from ovn-kubernetes 15m Normal Killing pod/maas-api-key-cleanup-e2e-shared-b-w6-cda0d9-29889465-sjjvl Stopping container cleanup 15m Normal Pulled pod/maas-api-revoke-sub-50ee1507-fjszz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-sub-50ee1507-fjszz Add eth0 [10.132.1.107/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-sub-4ac3bc12 Created pod: maas-api-revoke-sub-4ac3bc12-jlntx 15m Normal SuccessfulCreate job/maas-api-revoke-sub-50ee1507 Created pod: maas-api-revoke-sub-50ee1507-fjszz 15m Normal Completed job/maas-api-revoke-sub-e168c9e7 Job completed 15m Normal Pulled pod/maas-api-revoke-sub-4ac3bc12-jlntx Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Started pod/maas-api-revoke-sub-4ac3bc12-jlntx Container started 15m Normal Created pod/maas-api-revoke-sub-4ac3bc12-jlntx Container created 15m Normal Started pod/maas-api-revoke-sub-50ee1507-fjszz Container started 15m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9_odh-ai-gateway-infra(c0628c77-ff94-4a69-a0a0-af20a2b64e13) 15m Normal Created pod/maas-api-revoke-sub-50ee1507-fjszz Container created 15m Normal AddedInterface pod/maas-api-revoke-sub-3feedf6e-fn79k Add eth0 [10.132.1.108/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-sub-23bf79b7 Created pod: maas-api-revoke-sub-23bf79b7-9d2p7 15m Normal SuccessfulCreate job/maas-api-revoke-sub-3feedf6e Created pod: maas-api-revoke-sub-3feedf6e-fn79k 15m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6 Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w0-f07dfe-29889465-fj2q6_odh-ai-gateway-infra(46fda2f4-2ef1-46c6-a85b-cfce89fe474e) 15m Normal AddedInterface pod/maas-api-revoke-sub-23bf79b7-9d2p7 Add eth0 [10.133.1.8/23] from ovn-kubernetes 15m Normal Pulled pod/maas-api-revoke-sub-3feedf6e-fn79k Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Pulled pod/maas-api-revoke-sub-23bf79b7-9d2p7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-revoke-sub-23bf79b7-9d2p7 Container created 15m Normal Started pod/maas-api-revoke-sub-23bf79b7-9d2p7 Container started 15m Normal Started pod/maas-api-revoke-sub-3feedf6e-fn79k Container started 15m Normal Created pod/maas-api-revoke-sub-3feedf6e-fn79k Container created 15m Normal Completed job/maas-api-revoke-sub-50ee1507 Job completed 15m Normal Completed job/maas-api-revoke-sub-4ac3bc12 Job completed 15m Normal Completed job/maas-api-revoke-sub-23bf79b7 Job completed 15m Normal Completed job/maas-api-revoke-sub-3feedf6e Job completed 15m Normal Pulled pod/maas-api-revoke-keys-e2e-worker-w6-ee7d65-vzdrj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-w6-ee7d65-vzdrj Add eth0 [10.132.1.109/23] from ovn-kubernetes 15m Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-w6-ee7d65 Created pod: maas-api-revoke-keys-e2e-worker-w6-ee7d65-vzdrj 15m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-revoke-keys-e2e-worker-w6-ee7d65-vzdrj Container created 15m Normal Started pod/maas-api-revoke-keys-e2e-worker-w6-ee7d65-vzdrj Container started 15m Normal Killing pod/maas-api-e2e-worker-w0-f07dfe-7bdf6855d8-9zpmg Stopping container maas-api 15m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Pulled pod/maas-api-key-cleanup-29889465-r87lk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr Container created 15m Normal Started pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr Container started 15m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465 Deleted pod: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr 15m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465-26rfr_odh-ai-gateway-infra(1453dcde-0c6d-427d-890b-8f3542a0775a) 15m Normal Created pod/maas-api-key-cleanup-29889465-r87lk Container created 15m Normal Killing pod/maas-api-e2e-worker-w1-52a649-f4946f6bb-9kftn Stopping container maas-api 15m Normal Created pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln Container created 15m Normal Pulled pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 15m Normal Created pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 Container created 15m Normal Started pod/maas-api-key-cleanup-e2e-worker-w1-52a649-29889465-wdgj9 Container started 15m Normal Started pod/maas-api-key-cleanup-29889465-r87lk Container started 15m Normal Started pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln Container started 15m Warning BackOff pod/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln Back-off restarting failed container cleanup in pod maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln_odh-ai-gateway-infra(9382dbcf-317a-47db-b952-59244215f86c) 15m Warning BackOff pod/maas-api-key-cleanup-29889465-r87lk Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29889465-r87lk_odh-ai-gateway-infra(aaf4329d-4d56-4ce3-8eea-dbaf8da1c07a) 15m Normal SuccessfulDelete job/maas-api-key-cleanup-29889465 Deleted pod: maas-api-key-cleanup-29889465-r87lk 15m Normal Completed job/maas-api-revoke-keys-e2e-worker-w6-ee7d65 Job completed 15m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465 Job has reached the specified backoff limit 15m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w5-e34fd5 Saw completed job: maas-api-key-cleanup-e2e-worker-w5-e34fd5-29889465, condition: Failed 15m Normal SuccessfulDelete job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465 Deleted pod: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465-fdnln 14m Warning BackoffLimitExceeded job/maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465 Job has reached the specified backoff limit 14m Normal SawCompletedJob cronjob/maas-api-key-cleanup-e2e-worker-w6-ee7d65 Saw completed job: maas-api-key-cleanup-e2e-worker-w6-ee7d65-29889465, condition: Failed 14m Normal Killing pod/maas-api-e2e-worker-w5-e34fd5-758756996-tl6mw Stopping container maas-api 14m Normal SawCompletedJob cronjob/maas-api-key-cleanup Saw completed job: maas-api-key-cleanup-29889465, condition: Failed 14m Warning BackoffLimitExceeded job/maas-api-key-cleanup-29889465 Job has reached the specified backoff limit 14m Normal Pulled pod/maas-api-revoke-sub-d9fa5c55-sndgt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal Pulled pod/maas-api-revoke-sub-11d521cb-55x4w Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 14m Normal SuccessfulCreate job/maas-api-revoke-sub-d9fa5c55 Created pod: maas-api-revoke-sub-d9fa5c55-sndgt 14m Normal AddedInterface pod/maas-api-revoke-sub-d9fa5c55-sndgt Add eth0 [10.133.1.9/23] from ovn-kubernetes 14m Normal AddedInterface pod/maas-api-revoke-sub-11d521cb-55x4w Add eth0 [10.132.1.110/23] from ovn-kubernetes 14m Normal SuccessfulCreate job/maas-api-revoke-sub-11d521cb Created pod: maas-api-revoke-sub-11d521cb-55x4w 14m Normal Created pod/maas-api-revoke-sub-11d521cb-55x4w Container created 14m Normal Started pod/maas-api-revoke-sub-d9fa5c55-sndgt Container started 14m Normal Started pod/maas-api-revoke-sub-11d521cb-55x4w Container started 14m Normal Created pod/maas-api-revoke-sub-d9fa5c55-sndgt Container created 14m Normal Completed job/maas-api-revoke-sub-d9fa5c55 Job completed 14m Normal Completed job/maas-api-revoke-sub-11d521cb Job completed 14m Warning Unhealthy pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Readiness probe failed: Get "https://10.134.0.32:8443/health": dial tcp 10.134.0.32:8443: connect: connection refused 14m Normal Killing pod/maas-api-e2e-worker-w6-ee7d65-75bcf9cdb6-qrmtf Stopping container maas-api 13m Normal SuccessfulCreate job/maas-api-revoke-sub-85237e45 Created pod: maas-api-revoke-sub-85237e45-q8tpb 13m Normal Started pod/maas-api-revoke-sub-85237e45-q8tpb Container started 13m Normal Pulled pod/maas-api-revoke-sub-85237e45-q8tpb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal Created pod/maas-api-revoke-sub-85237e45-q8tpb Container created 13m Normal AddedInterface pod/maas-api-revoke-sub-85237e45-q8tpb Add eth0 [10.133.1.11/23] from ovn-kubernetes 13m Normal Completed job/maas-api-revoke-sub-85237e45 Job completed 13m Normal SuccessfulCreate job/maas-api-revoke-sub-c1e271a9 Created pod: maas-api-revoke-sub-c1e271a9-l5b9d 13m Normal AddedInterface pod/maas-api-revoke-sub-c1e271a9-l5b9d Add eth0 [10.133.1.12/23] from ovn-kubernetes 13m Normal Pulled pod/maas-api-revoke-sub-c1e271a9-l5b9d Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 13m Normal Created pod/maas-api-revoke-sub-c1e271a9-l5b9d Container created 13m Normal Started pod/maas-api-revoke-sub-c1e271a9-l5b9d Container started 13m Normal Completed job/maas-api-revoke-sub-c1e271a9 Job completed 12m Normal SuccessfulCreate job/maas-api-revoke-sub-2e1f5b5f Created pod: maas-api-revoke-sub-2e1f5b5f-5vjzz 12m Normal AddedInterface pod/maas-api-revoke-sub-2e1f5b5f-5vjzz Add eth0 [10.132.1.116/23] from ovn-kubernetes 12m Normal Pulled pod/maas-api-revoke-sub-2e1f5b5f-5vjzz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal Created pod/maas-api-revoke-sub-2e1f5b5f-5vjzz Container created 12m Normal Started pod/maas-api-revoke-sub-2e1f5b5f-5vjzz Container started 12m Normal Completed job/maas-api-revoke-sub-2e1f5b5f Job completed 12m Normal SuccessfulCreate job/maas-api-revoke-sub-ec843018 Created pod: maas-api-revoke-sub-ec843018-rbhlz 12m Normal Started pod/maas-api-revoke-sub-ec843018-rbhlz Container started 12m Normal Pulled pod/maas-api-revoke-sub-ec843018-rbhlz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal AddedInterface pod/maas-api-revoke-sub-ec843018-rbhlz Add eth0 [10.132.1.117/23] from ovn-kubernetes 12m Normal Created pod/maas-api-revoke-sub-ec843018-rbhlz Container created 12m Normal Completed job/maas-api-revoke-sub-ec843018 Job completed 12m Normal SuccessfulCreate job/maas-api-revoke-sub-046e1343 Created pod: maas-api-revoke-sub-046e1343-ldftn 12m Normal AddedInterface pod/maas-api-revoke-sub-046e1343-ldftn Add eth0 [10.132.1.118/23] from ovn-kubernetes 12m Normal Pulled pod/maas-api-revoke-sub-046e1343-ldftn Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 12m Normal Created pod/maas-api-revoke-sub-046e1343-ldftn Container created 12m Normal Started pod/maas-api-revoke-sub-046e1343-ldftn Container started 12m Normal Completed job/maas-api-revoke-sub-046e1343 Job completed 11m Normal SuccessfulCreate job/maas-api-revoke-sub-d3fba056 Created pod: maas-api-revoke-sub-d3fba056-7jzlb 11m Normal Pulled pod/maas-api-revoke-sub-d3fba056-7jzlb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal AddedInterface pod/maas-api-revoke-sub-d3fba056-7jzlb Add eth0 [10.132.1.119/23] from ovn-kubernetes 11m Normal Created pod/maas-api-revoke-sub-d3fba056-7jzlb Container created 11m Normal Started pod/maas-api-revoke-sub-d3fba056-7jzlb Container started 11m Normal Completed job/maas-api-revoke-sub-d3fba056 Job completed 11m Normal SuccessfulCreate job/maas-api-revoke-sub-ae594979 Created pod: maas-api-revoke-sub-ae594979-6dbvl 11m Normal Created pod/maas-api-revoke-sub-ae594979-6dbvl Container created 11m Normal AddedInterface pod/maas-api-revoke-sub-ae594979-6dbvl Add eth0 [10.132.1.120/23] from ovn-kubernetes 11m Normal Started pod/maas-api-revoke-sub-ae594979-6dbvl Container started 11m Normal Pulled pod/maas-api-revoke-sub-ae594979-6dbvl Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal Completed job/maas-api-revoke-sub-ae594979 Job completed 11m Normal AddedInterface pod/maas-api-revoke-sub-a4aef7d7-h5ssk Add eth0 [10.132.1.121/23] from ovn-kubernetes 11m Normal Pulled pod/maas-api-revoke-sub-a4aef7d7-h5ssk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 11m Normal SuccessfulCreate job/maas-api-revoke-sub-a4aef7d7 Created pod: maas-api-revoke-sub-a4aef7d7-h5ssk 11m Normal Created pod/maas-api-revoke-sub-a4aef7d7-h5ssk Container created 11m Normal Started pod/maas-api-revoke-sub-a4aef7d7-h5ssk Container started 11m Normal Completed job/maas-api-revoke-sub-a4aef7d7 Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-79805ca9 Created pod: maas-api-revoke-sub-79805ca9-9f8gj 10m Normal AddedInterface pod/maas-api-revoke-sub-79805ca9-9f8gj Add eth0 [10.132.1.122/23] from ovn-kubernetes 10m Normal Pulled pod/maas-api-revoke-sub-79805ca9-9f8gj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal Created pod/maas-api-revoke-sub-79805ca9-9f8gj Container created 10m Normal Started pod/maas-api-revoke-sub-79805ca9-9f8gj Container started 10m Normal Completed job/maas-api-revoke-sub-79805ca9 Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-0b7e8edb Created pod: maas-api-revoke-sub-0b7e8edb-q5xrk 10m Normal Started pod/maas-api-revoke-sub-0b7e8edb-q5xrk Container started 10m Normal Created pod/maas-api-revoke-sub-0b7e8edb-q5xrk Container created 10m Normal Pulled pod/maas-api-revoke-sub-0b7e8edb-q5xrk Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal AddedInterface pod/maas-api-revoke-sub-0b7e8edb-q5xrk Add eth0 [10.132.1.123/23] from ovn-kubernetes 10m Normal Completed job/maas-api-revoke-sub-0b7e8edb Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-df4xz 10m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-df4xz Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-df4xz Add eth0 [10.132.1.124/23] from ovn-kubernetes 10m Normal Started pod/maas-api-revoke-sub-3d4156f1-df4xz Container started 10m Normal Created pod/maas-api-revoke-sub-3d4156f1-df4xz Container created 10m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 10m Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-br444 10m Normal Created pod/maas-api-revoke-sub-3d4156f1-br444 Container created 10m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-br444 Add eth0 [10.133.1.15/23] from ovn-kubernetes 10m Normal Started pod/maas-api-revoke-sub-3d4156f1-br444 Container started 10m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-br444 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 10m Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 9m40s Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-65lbb 9m39s Normal Pulled pod/maas-api-revoke-sub-3d4156f1-65lbb Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 9m39s Normal Created pod/maas-api-revoke-sub-3d4156f1-65lbb Container created 9m39s Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-65lbb Add eth0 [10.133.1.16/23] from ovn-kubernetes 9m39s Normal Started pod/maas-api-revoke-sub-3d4156f1-65lbb Container started 9m36s Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 9m12s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d Created pod: maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp 9m12s Normal AddedInterface pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Add eth0 [10.133.1.18/23] from ovn-kubernetes 9m12s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-a5b3f0 Scaled up replica set maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d from 0 to 1 9m12s Normal Pulling pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 9m11s Normal Pulled pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 442ms (442ms including waiting). Image size: 194510193 bytes. 9m11s Normal Created pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Container created 9m11s Normal Started pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Container started 8m32s Normal SuccessfulCreate job/maas-api-revoke-sub-fc5ec89e Created pod: maas-api-revoke-sub-fc5ec89e-7mfmj 8m31s Normal Created pod/maas-api-revoke-sub-fc5ec89e-7mfmj Container created 8m31s Normal Started pod/maas-api-revoke-sub-fc5ec89e-7mfmj Container started 8m31s Normal Pulled pod/maas-api-revoke-sub-fc5ec89e-7mfmj Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m31s Normal AddedInterface pod/maas-api-revoke-sub-fc5ec89e-7mfmj Add eth0 [10.132.1.125/23] from ovn-kubernetes 8m28s Normal Completed job/maas-api-revoke-sub-fc5ec89e Job completed 8m21s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0 Created pod: maas-api-revoke-keys-e2e-worker-single-main-a5b3f0-v4zm7 8m20s Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0-v4zm7 Container started 8m20s Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0-v4zm7 Add eth0 [10.132.1.126/23] from ovn-kubernetes 8m20s Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0-v4zm7 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m20s Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0-v4zm7 Container created 8m17s Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-a5b3f0 Job completed 8m9s Normal Killing pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Stopping container maas-api 8m9s Warning FailedToUpdateEndpoint endpoints/maas-api-e2e-worker-single-main-a5b3f0 Failed to update endpoint odh-ai-gateway-infra/maas-api-e2e-worker-single-main-a5b3f0: Operation cannot be fulfilled on endpoints "maas-api-e2e-worker-single-main-a5b3f0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/odh-ai-gateway-infra/maas-api-e2e-worker-single-main-a5b3f0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a2e0c99e-57df-4455-8097-4e462e44e08a, UID in object meta: 8m9s Warning Unhealthy pod/maas-api-e2e-worker-single-main-a5b3f0-84b6ff667d-skmlp Readiness probe failed: Get "https://10.133.1.18:8443/health": dial tcp 10.133.1.18:8443: connect: connection refused 8m1s Normal SuccessfulCreate job/maas-api-revoke-sub-3d4156f1 Created pod: maas-api-revoke-sub-3d4156f1-ps4mr 8m Normal Pulled pod/maas-api-revoke-sub-3d4156f1-ps4mr Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 8m Normal Created pod/maas-api-revoke-sub-3d4156f1-ps4mr Container created 8m Normal Started pod/maas-api-revoke-sub-3d4156f1-ps4mr Container started 8m Normal AddedInterface pod/maas-api-revoke-sub-3d4156f1-ps4mr Add eth0 [10.133.1.22/23] from ovn-kubernetes 7m57s Normal Completed job/maas-api-revoke-sub-3d4156f1 Job completed 6m12s Normal SuccessfulCreate job/maas-api-revoke-sub-d576e68b Created pod: maas-api-revoke-sub-d576e68b-k2ft9 6m11s Normal Created pod/maas-api-revoke-sub-d576e68b-k2ft9 Container created 6m11s Normal Started pod/maas-api-revoke-sub-d576e68b-k2ft9 Container started 6m11s Normal Pulled pod/maas-api-revoke-sub-d576e68b-k2ft9 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 6m11s Normal AddedInterface pod/maas-api-revoke-sub-d576e68b-k2ft9 Add eth0 [10.133.1.23/23] from ovn-kubernetes 6m7s Normal Completed job/maas-api-revoke-sub-d576e68b Job completed 5m55s Normal SuccessfulCreate job/maas-api-revoke-sub-d2bc93bc Created pod: maas-api-revoke-sub-d2bc93bc-58w2x 5m54s Normal Created pod/maas-api-revoke-sub-d2bc93bc-58w2x Container created 5m54s Normal Pulled pod/maas-api-revoke-sub-d2bc93bc-58w2x Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 5m54s Normal Started pod/maas-api-revoke-sub-d2bc93bc-58w2x Container started 5m54s Normal AddedInterface pod/maas-api-revoke-sub-d2bc93bc-58w2x Add eth0 [10.133.1.24/23] from ovn-kubernetes 5m51s Normal Completed job/maas-api-revoke-sub-d2bc93bc Job completed 5m37s Normal Pulling pod/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 5m37s Normal ScalingReplicaSet deployment/maas-api-e2e-worker-single-main-d61c7a Scaled up replica set maas-api-e2e-worker-single-main-d61c7a-66cb874f59 from 0 to 1 5m37s Normal SuccessfulCreate replicaset/maas-api-e2e-worker-single-main-d61c7a-66cb874f59 Created pod: maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb 5m37s Normal AddedInterface pod/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb Add eth0 [10.133.1.26/23] from ovn-kubernetes 5m36s Normal Pulled pod/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 311ms (311ms including waiting). Image size: 194510193 bytes. 5m36s Normal Started pod/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb Container started 5m36s Normal Created pod/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb Container created 5m2s Normal SuccessfulCreate job/maas-api-revoke-sub-4ebe2e92 Created pod: maas-api-revoke-sub-4ebe2e92-tj49n 5m1s Normal Started pod/maas-api-revoke-sub-4ebe2e92-tj49n Container started 5m1s Normal AddedInterface pod/maas-api-revoke-sub-4ebe2e92-tj49n Add eth0 [10.132.1.128/23] from ovn-kubernetes 5m1s Normal Pulled pod/maas-api-revoke-sub-4ebe2e92-tj49n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 5m1s Normal Created pod/maas-api-revoke-sub-4ebe2e92-tj49n Container created 4m58s Normal Completed job/maas-api-revoke-sub-4ebe2e92 Job completed 4m51s Normal SuccessfulCreate job/maas-api-revoke-keys-e2e-worker-single-main-d61c7a Created pod: maas-api-revoke-keys-e2e-worker-single-main-d61c7a-tnn8f 4m50s Normal Pulled pod/maas-api-revoke-keys-e2e-worker-single-main-d61c7a-tnn8f Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 4m50s Normal Created pod/maas-api-revoke-keys-e2e-worker-single-main-d61c7a-tnn8f Container created 4m50s Normal AddedInterface pod/maas-api-revoke-keys-e2e-worker-single-main-d61c7a-tnn8f Add eth0 [10.132.1.129/23] from ovn-kubernetes 4m50s Normal Started pod/maas-api-revoke-keys-e2e-worker-single-main-d61c7a-tnn8f Container started 4m47s Normal Completed job/maas-api-revoke-keys-e2e-worker-single-main-d61c7a Job completed 4m40s Normal Killing pod/maas-api-e2e-worker-single-main-d61c7a-66cb874f59-qftdb Stopping container maas-api 3m46s Normal AddedInterface pod/maas-api-revoke-sub-452b6d7b-fvl2n Add eth0 [10.133.1.32/23] from ovn-kubernetes 3m46s Normal Pulled pod/maas-api-revoke-sub-452b6d7b-fvl2n Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m46s Normal SuccessfulCreate job/maas-api-revoke-sub-452b6d7b Created pod: maas-api-revoke-sub-452b6d7b-fvl2n 3m45s Normal Started pod/maas-api-revoke-sub-452b6d7b-fvl2n Container started 3m45s Normal Created pod/maas-api-revoke-sub-452b6d7b-fvl2n Container created 3m42s Normal Completed job/maas-api-revoke-sub-452b6d7b Job completed 3m26s Normal SuccessfulCreate job/maas-api-revoke-sub-3e31a506 Created pod: maas-api-revoke-sub-3e31a506-mx6gc 3m25s Normal AddedInterface pod/maas-api-revoke-sub-3e31a506-mx6gc Add eth0 [10.133.1.33/23] from ovn-kubernetes 3m24s Normal Started pod/maas-api-revoke-sub-3e31a506-mx6gc Container started 3m24s Normal Created pod/maas-api-revoke-sub-3e31a506-mx6gc Container created 3m24s Normal Pulled pod/maas-api-revoke-sub-3e31a506-mx6gc Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m21s Normal Completed job/maas-api-revoke-sub-3e31a506 Job completed 3m5s Normal AddedInterface pod/maas-api-revoke-sub-f929de75-j7xrt Add eth0 [10.133.1.34/23] from ovn-kubernetes 3m5s Normal SuccessfulCreate job/maas-api-revoke-sub-f929de75 Created pod: maas-api-revoke-sub-f929de75-j7xrt 3m5s Normal Pulled pod/maas-api-revoke-sub-f929de75-j7xrt Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 3m4s Normal Started pod/maas-api-revoke-sub-f929de75-j7xrt Container started 3m4s Normal Created pod/maas-api-revoke-sub-f929de75-j7xrt Container created 3m2s Normal Completed job/maas-api-revoke-sub-f929de75 Job completed 2m53s Normal SuccessfulCreate replicaset/maas-api-595cc648c Created pod: maas-api-595cc648c-4jkwp 2m53s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-5c48877c75 from 1 to 2 2m53s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-595cc648c from 0 to 1 2m53s Normal SuccessfulCreate replicaset/maas-api-5c48877c75 Created pod: maas-api-5c48877c75-spd87 2m52s Normal Created pod/maas-api-5c48877c75-spd87 Container created 2m52s Normal AddedInterface pod/maas-api-5c48877c75-spd87 Add eth0 [10.133.1.35/23] from ovn-kubernetes 2m52s Normal Started pod/maas-api-5c48877c75-spd87 Container started 2m52s Normal Pulled pod/maas-api-5c48877c75-spd87 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 369ms (369ms including waiting). Image size: 194510193 bytes. 2m52s Normal Pulling pod/maas-api-5c48877c75-spd87 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 2m52s Normal Started pod/maas-api-595cc648c-4jkwp Container started 2m52s Normal Created pod/maas-api-595cc648c-4jkwp Container created 2m52s Normal Pulled pod/maas-api-595cc648c-4jkwp Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 361ms (361ms including waiting). Image size: 194510193 bytes. 2m52s Normal Pulling pod/maas-api-595cc648c-4jkwp Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 2m52s Normal AddedInterface pod/maas-api-595cc648c-4jkwp Add eth0 [10.133.1.36/23] from ovn-kubernetes 2m46s Normal SuccessfulCreate replicaset/maas-api-595cc648c Created pod: maas-api-595cc648c-w57x7 2m46s Normal SuccessfulDelete replicaset/maas-api-5c48877c75 Deleted pod: maas-api-5c48877c75-spd87 2m46s Normal Killing pod/maas-api-5c48877c75-spd87 Stopping container maas-api 2m46s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-5c48877c75 from 2 to 1 2m46s Normal ScalingReplicaSet deployment/maas-api Scaled up replica set maas-api-595cc648c from 1 to 2 2m45s Normal Pulled pod/maas-api-595cc648c-w57x7 Successfully pulled image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" in 360ms (360ms including waiting). Image size: 194510193 bytes. 2m45s Normal Pulling pod/maas-api-595cc648c-w57x7 Pulling image "quay.io/opendatahub/maas-api:ccce7752af146eb3de9e99df107c26f414878726" 2m45s Normal AddedInterface pod/maas-api-595cc648c-w57x7 Add eth0 [10.132.1.130/23] from ovn-kubernetes 2m45s Normal Created pod/maas-api-595cc648c-w57x7 Container created 2m45s Normal Started pod/maas-api-595cc648c-w57x7 Container started 2m38s Normal ScalingReplicaSet deployment/maas-api Scaled down replica set maas-api-5c48877c75 from 1 to 0 2m38s Normal Killing pod/maas-api-5c48877c75-4zm8v Stopping container maas-api 2m38s Normal SuccessfulDelete replicaset/maas-api-5c48877c75 Deleted pod: maas-api-5c48877c75-4zm8v 2m37s Warning Unhealthy pod/maas-api-5c48877c75-4zm8v Readiness probe failed: Get "https://10.134.0.28:8443/health": dial tcp 10.134.0.28:8443: connect: connection refused 2m29s Normal AddedInterface pod/maas-api-revoke-sub-f03629db-sqs7j Add eth0 [10.134.0.171/23] from ovn-kubernetes 2m29s Normal SuccessfulCreate job/maas-api-revoke-sub-f03629db Created pod: maas-api-revoke-sub-f03629db-sqs7j 2m28s Normal Created pod/maas-api-revoke-sub-f03629db-sqs7j Container created 2m28s Normal Started pod/maas-api-revoke-sub-f03629db-sqs7j Container started 2m28s Normal Pulled pod/maas-api-revoke-sub-f03629db-sqs7j Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m25s Normal Completed job/maas-api-revoke-sub-f03629db Job completed 2m19s Normal SuccessfulCreate job/maas-api-revoke-sub-0165d7d2 Created pod: maas-api-revoke-sub-0165d7d2-dzgvv 2m18s Normal Pulled pod/maas-api-revoke-sub-0165d7d2-dzgvv Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m18s Normal Started pod/maas-api-revoke-sub-0165d7d2-dzgvv Container started 2m18s Normal AddedInterface pod/maas-api-revoke-sub-0165d7d2-dzgvv Add eth0 [10.134.0.172/23] from ovn-kubernetes 2m18s Normal Created pod/maas-api-revoke-sub-0165d7d2-dzgvv Container created 2m14s Normal Completed job/maas-api-revoke-sub-0165d7d2 Job completed 2m8s Normal SuccessfulCreate job/maas-api-revoke-sub-6b19338f Created pod: maas-api-revoke-sub-6b19338f-cdjr4 2m7s Normal AddedInterface pod/maas-api-revoke-sub-6b19338f-cdjr4 Add eth0 [10.134.0.173/23] from ovn-kubernetes 2m7s Normal Pulled pod/maas-api-revoke-sub-6b19338f-cdjr4 Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2m7s Normal Created pod/maas-api-revoke-sub-6b19338f-cdjr4 Container created 2m7s Normal Started pod/maas-api-revoke-sub-6b19338f-cdjr4 Container started 2m4s Normal Completed job/maas-api-revoke-sub-6b19338f Job completed 17s Normal SuccessfulCreate job/maas-api-key-cleanup-29889480 Created pod: maas-api-key-cleanup-29889480-dwqfh 17s Normal SuccessfulCreate cronjob/maas-api-key-cleanup Created job maas-api-key-cleanup-29889480 17s Normal AddedInterface pod/maas-api-key-cleanup-29889480-dwqfh Add eth0 [10.134.0.174/23] from ovn-kubernetes 2s Normal Pulled pod/maas-api-key-cleanup-29889480-dwqfh Container image "registry.redhat.io/ubi9/ubi-minimal:9.7" already present on machine and can be accessed by the pod 2s Normal Started pod/maas-api-key-cleanup-29889480-dwqfh Container started 2s Normal Created pod/maas-api-key-cleanup-29889480-dwqfh Container created 1s Warning BackOff pod/maas-api-key-cleanup-29889480-dwqfh Back-off restarting failed container cleanup in pod maas-api-key-cleanup-29889480-dwqfh_odh-ai-gateway-infra(42907fc3-d91d-4c89-9689-15dd4cc98e24) 0s Normal SuccessfulDelete job/maas-api-key-cleanup-29889480 Deleted pod: maas-api-key-cleanup-29889480-dwqfh