Time Namespace Component RelatedObject Reason Message

opendatahub

test-curl-7325-7cdd3a

Scheduled

Successfully assigned opendatahub/test-curl-7325-7cdd3a to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s to ip-10-0-130-250.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-tf6tc

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-tf6tc to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg to ip-10-0-130-250.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-89fs5

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-89fs5 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

Scheduled

Successfully assigned openshift-ingress/e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf to ip-10-0-128-236.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-m2fn9

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-m2fn9 to ip-10-0-130-250.ec2.internal

openshift-jobset-operator

jobset-controller-manager-68b94c7695-hqsdp

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-68b94c7695-hqsdp to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

Scheduled

Successfully assigned openshift-ingress/e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9 to ip-10-0-128-236.ec2.internal

openshift-ingress

router-default-f6d947f75-ln5z8

Scheduled

Successfully assigned openshift-ingress/router-default-f6d947f75-ln5z8 to ip-10-0-130-250.ec2.internal

openshift-ingress

router-default-f6d947f75-ln5z8

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-f6d947f75-ln5z8

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp to ip-10-0-130-84.ec2.internal

kuadrant-system

authorino-55b8fd5845-fdl6z

Scheduled

Successfully assigned kuadrant-system/authorino-55b8fd5845-fdl6z to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr to ip-10-0-128-236.ec2.internal

kuadrant-system

authorino-65db9f99d7-gkmz2

Scheduled

Successfully assigned kuadrant-system/authorino-65db9f99d7-gkmz2 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf to ip-10-0-130-84.ec2.internal

kuadrant-system

authorino-74ccc46849-m6vxp

Scheduled

Successfully assigned kuadrant-system/authorino-74ccc46849-m6vxp to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt to ip-10-0-128-236.ec2.internal

kuadrant-system

authorino-7597569d74-sknct

Scheduled

Successfully assigned kuadrant-system/authorino-7597569d74-sknct to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q to ip-10-0-128-236.ec2.internal

kuadrant-system

authorino-75d56799cb-n8rw5

Scheduled

Successfully assigned kuadrant-system/authorino-75d56799cb-n8rw5 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp to ip-10-0-128-236.ec2.internal

kuadrant-system

authorino-76c7f55f9d-d5v59

Scheduled

Successfully assigned kuadrant-system/authorino-76c7f55f9d-d5v59 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm to ip-10-0-130-250.ec2.internal

kuadrant-system

authorino-dc8775675-n5vjm

Scheduled

Successfully assigned kuadrant-system/authorino-dc8775675-n5vjm to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz to ip-10-0-130-250.ec2.internal

kuadrant-system

authorino-operator-779bff956b-bmwkw

Scheduled

Successfully assigned kuadrant-system/authorino-operator-779bff956b-bmwkw to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg to ip-10-0-130-84.ec2.internal

kuadrant-system

developer-portal-controller-66d8dbb8c8-d7cds

Scheduled

Successfully assigned kuadrant-system/developer-portal-controller-66d8dbb8c8-d7cds to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt to ip-10-0-128-236.ec2.internal

kuadrant-system

dns-operator-controller-manager-57f5c66455-l7hkg

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-57f5c66455-l7hkg to ip-10-0-130-84.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6f89d9f6ccrln44

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6f89d9f6ccrln44 to ip-10-0-130-84.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-64bcb8d955-zr5b9 to ip-10-0-130-250.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-64bcb8d955-rpf9x to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6 to ip-10-0-130-84.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-64bcb8d955-44nvn to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c to ip-10-0-130-84.ec2.internal

kuadrant-system

kuadrant-console-plugin-7bbc6bb9d7-qfgcb

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-7bbc6bb9d7-qfgcb to ip-10-0-128-236.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6xz9f to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n to ip-10-0-130-84.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-27c49

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-6b575997cc-27c49 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g to ip-10-0-128-236.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-76d5f9c5c-fb457

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-76d5f9c5c-fb457 to ip-10-0-130-84.ec2.internal

opendatahub

test-curl-7325-632f59

Scheduled

Successfully assigned opendatahub/test-curl-7325-632f59 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69 to ip-10-0-128-236.ec2.internal

opendatahub

test-curl-7322-eef857

Scheduled

Successfully assigned opendatahub/test-curl-7322-eef857 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6 to ip-10-0-128-236.ec2.internal

kuadrant-system

limitador-limitador-77dd99c685-8bwz6

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-77dd99c685-8bwz6 to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g to ip-10-0-130-84.ec2.internal

opendatahub

test-curl-7322-0bf4a7

Scheduled

Successfully assigned opendatahub/test-curl-7322-0bf4a7 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp to ip-10-0-130-84.ec2.internal

cert-manager

cert-manager-597b95cb84-tgr57

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-tgr57 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb to ip-10-0-128-236.ec2.internal

kuadrant-system

limitador-limitador-f7d6b5c7c-n4z9t

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-f7d6b5c7c-n4z9t to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-58d08b-c58b968db-9f7zq to ip-10-0-130-84.ec2.internal

opendatahub

odh-model-controller-769875db56-d66qd

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-d66qd to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-da151d-697b678888-d8zsf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-da151d-697b678888-d8zsf to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm to ip-10-0-128-236.ec2.internal

kuadrant-system

limitador-operator-controller-manager-68669df9c4-hb58c

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-68669df9c4-hb58c to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk to ip-10-0-130-84.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-6kc8h

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-6kc8h to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6 to ip-10-0-130-250.ec2.internal

opendatahub

maas-controller-8689bcdb59-997v7

Scheduled

Successfully assigned opendatahub/maas-controller-8689bcdb59-997v7 to ip-10-0-130-250.ec2.internal

kuadrant-system

mcp-gateway-controller-6c98b995c5-5hfqg

Scheduled

Successfully assigned kuadrant-system/mcp-gateway-controller-6c98b995c5-5hfqg to ip-10-0-130-250.ec2.internal

opendatahub

maas-controller-5456657644-j2hgt

Scheduled

Successfully assigned opendatahub/maas-controller-5456657644-j2hgt to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-9l4x8

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-9l4x8 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz to ip-10-0-130-250.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-gtngp

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-gtngp to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf to ip-10-0-130-84.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9 to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p to ip-10-0-128-236.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-qhvxv to ip-10-0-128-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-zkxdg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-zkxdg to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

Scheduled

Successfully assigned openshift-ingress/e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l to ip-10-0-130-84.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-lw4w4

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-lw4w4 to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx to ip-10-0-128-236.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-5tcnq

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-5tcnq to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np to ip-10-0-128-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-47vdr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-47vdr to ip-10-0-130-250.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-9mddx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9mddx to ip-10-0-128-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-9zh44

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9zh44 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9 to ip-10-0-130-250.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-z2svs

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-z2svs to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw to ip-10-0-128-236.ec2.internal

openshift-ingress

kube-auth-proxy-9c55b8cc4-7pfgm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9c55b8cc4-7pfgm to ip-10-0-128-236.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-nj9sw

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-nj9sw to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7 to ip-10-0-130-84.ec2.internal

openshift-ingress

kube-auth-proxy-9c55b8cc4-f2d66

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9c55b8cc4-f2d66 to ip-10-0-130-250.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-xrlvs

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-xrlvs to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6 to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs to ip-10-0-130-84.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-zz7vx to ip-10-0-128-236.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-9kmd2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-9kmd2 to ip-10-0-130-84.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-cntbh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-cntbh to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m to ip-10-0-130-84.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-cxsgh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-cxsgh to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk to ip-10-0-130-250.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-fhwtr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-fhwtr to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv to ip-10-0-128-236.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-h2gf2 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz to ip-10-0-130-84.ec2.internal

opendatahub

ai-gateway-controller-cf84bc4f4-dmpmz

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-cf84bc4f4-dmpmz to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8 to ip-10-0-130-250.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-nrbjr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-nrbjr to ip-10-0-130-84.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-p8z8x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-p8z8x to ip-10-0-130-250.ec2.internal

openshift-ingress

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v to ip-10-0-128-236.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-qmzkh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-qmzkh to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq to ip-10-0-130-250.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-wjstn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-wjstn to ip-10-0-128-236.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-67bf986f99-x4522

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-67bf986f99-x4522 to ip-10-0-128-236.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx to ip-10-0-130-84.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n to ip-10-0-130-84.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-8pcnj

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-8pcnj to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp to ip-10-0-128-236.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-7mmmn

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-7mmmn to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-znczm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-znczm to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7 to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f to ip-10-0-130-84.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks to ip-10-0-130-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2 to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv to ip-10-0-128-236.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87 to ip-10-0-130-84.ec2.internal

openshift-ingress

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss to ip-10-0-130-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq to ip-10-0-128-236.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-f6d947f75 from 0 to 1

openshift-ingress

replicaset-controller

router-default-f6d947f75

SuccessfulCreate

Created pod: router-default-f6d947f75-ln5z8

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-f6d947f75-ln5z8

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-f6d947f75-ln5z8

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-f6d947f75-ln5z8

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-f6d947f75-ln5z8

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-f6d947f75-ln5z8

Started

Container started

openshift-ingress

multus

router-default-f6d947f75-ln5z8

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-f6d947f75-ln5z8

Created

Container created

openshift-ingress

kubelet

router-default-f6d947f75-ln5z8

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-zkxdg

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-zkxdg

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zkxdg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zkxdg

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zkxdg

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zkxdg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.917s (2.917s including waiting). Image size: 185476477 bytes.

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zkxdg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-67bf986f99 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-h2gf2

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-67dd9d5b47 from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-67dd9d5b47

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zkxdg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-h2gf2

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.361s (5.361s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.09s (5.09s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-67dd9d5b47-l6g6p

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-64bcb8d955

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-64bcb8d955-zr5b9

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-64bcb8d955

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-64bcb8d955-44nvn

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-64bcb8d955

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-64bcb8d955-rpf9x

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-64bcb8d955-44nvn

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-64bcb8d955 from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

operator-lifecycle-manager

install-tw6mm

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.708s (2.708s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.677s (2.677s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 319ms (319ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.451s (3.451s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 340ms (340ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-rpf9x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-zr5b9

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

opendatahub-operator-controller-manager-64bcb8d955-zr5b9_b4b356f3-15d3-449f-8d88-39fd269bd61f

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-64bcb8d955-zr5b9_b4b356f3-15d3-449f-8d88-39fd269bd61f became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 437ms (437ms including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64bcb8d955-44nvn

Created

Container created

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-89fs5

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-89fs5

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-76d5f9c5c

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-76d5f9c5c-fb457

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-89fs5

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-76d5f9c5c from 0 to 1

kuadrant-system

multus

kuadrant-operator-controller-manager-76d5f9c5c-fb457

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-76d5f9c5c-fb457

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-89fs5

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-89fs5

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-89fs5

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.396s (2.396s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-89fs5_1adde10d-ded4-429e-92f0-e89c94ba3b86 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-76d5f9c5c-fb457

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-76d5f9c5c-fb457

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299" in 5.195s (5.195s including waiting). Image size: 481302115 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-76d5f9c5c-fb457

Created

Container created

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-76d5f9c5c-fb457_cc2d4bcc-0855-49e1-862c-966b3f0207e5

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-76d5f9c5c-fb457_cc2d4bcc-0855-49e1-862c-966b3f0207e5 became leader

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-57f5c66455 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-57f5c66455

SuccessfulCreate

Created pod: dns-operator-controller-manager-57f5c66455-l7hkg

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-m2fn9

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-779bff956b

SuccessfulCreate

Created pod: authorino-operator-779bff956b-bmwkw

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-5hfqg

Pulling

Pulling image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa"

kuadrant-system

replicaset-controller

mcp-gateway-controller-6c98b995c5

SuccessfulCreate

Created pod: mcp-gateway-controller-6c98b995c5-5hfqg

kuadrant-system

deployment-controller

mcp-gateway-controller

ScalingReplicaSet

Scaled up replica set mcp-gateway-controller-6c98b995c5 from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-m2fn9

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-l7hkg

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-m2fn9

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

multus

dns-operator-controller-manager-57f5c66455-l7hkg

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-779bff956b from 0 to 1

kuadrant-system

multus

mcp-gateway-controller-6c98b995c5-5hfqg

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-6b575997cc

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-6b575997cc-27c49

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-6b575997cc from 0 to 1

kuadrant-system

multus

limitador-operator-controller-manager-68669df9c4-hb58c

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-779bff956b-bmwkw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402"

kuadrant-system

multus

authorino-operator-779bff956b-bmwkw

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-68669df9c4

SuccessfulCreate

Created pod: limitador-operator-controller-manager-68669df9c4-hb58c
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-27c49

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299" already present on machine and can be accessed by the pod

kuadrant-system

multus

kuadrant-operator-controller-manager-6b575997cc-27c49

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallWaiting

installing: deployment changed old hash=cANVQWsMijO7jh4q54feZiAV5JoSVHghXEcv3T, new hash=bSpDK9cnxyBvAVW8xGsnHy6YY5TdY2zRcyng1I

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-68669df9c4 from 0 to 1

kuadrant-system

replicaset-controller

developer-portal-controller-66d8dbb8c8

SuccessfulCreate

Created pod: developer-portal-controller-66d8dbb8c8-d7cds

kuadrant-system

deployment-controller

developer-portal-controller

ScalingReplicaSet

Scaled up replica set developer-portal-controller-66d8dbb8c8 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-27c49

Started

Container started

kuadrant-system

replicaset-controller

kuadrant-console-plugin-7bbc6bb9d7

SuccessfulCreate

Created pod: kuadrant-console-plugin-7bbc6bb9d7-qfgcb

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-7bbc6bb9d7 from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-27c49

Created

Container created

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-d7cds

Pulling

Pulling image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90"

kuadrant-system

multus

developer-portal-controller-66d8dbb8c8-d7cds

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-hb58c

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3"

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-5hfqg

Created

Container created

kuadrant-system

kubelet

authorino-operator-779bff956b-bmwkw

Created

Container created

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-5hfqg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa" in 2.988s (2.988s including waiting). Image size: 158458620 bytes.

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-5hfqg

Started

Container started

kuadrant-system

kubelet

authorino-operator-779bff956b-bmwkw

Started

Container started

kuadrant-system

kubelet

authorino-operator-779bff956b-bmwkw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402" in 2.205s (2.205s including waiting). Image size: 167835888 bytes.

kuadrant-system

authorino-operator-779bff956b-bmwkw_3c872fc2-a830-46f5-956e-d4ce4db9a7f4

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-779bff956b-bmwkw_3c872fc2-a830-46f5-956e-d4ce4db9a7f4 became leader

kuadrant-system

multus

kuadrant-console-plugin-7bbc6bb9d7-qfgcb

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-qfgcb

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b"

kuadrant-system

dns-operator-controller-manager-57f5c66455-l7hkg_29460adf-af78-42f4-a80e-7e3506d66f32

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-57f5c66455-l7hkg_29460adf-af78-42f4-a80e-7e3506d66f32 became leader

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-m2fn9

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-m2fn9

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-m2fn9

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.951s (2.951s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-l7hkg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388" in 2.999s (2.999s including waiting). Image size: 192755988 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-hb58c

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3" in 2.838s (2.838s including waiting). Image size: 178063410 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-hb58c

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-hb58c

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-qfgcb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b" in 2.394s (2.394s including waiting). Image size: 120696640 bytes.

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-qfgcb

Created

Container created

kuadrant-system

limitador-operator-controller-manager-68669df9c4-hb58c_ac62d6fa-bfbe-41d5-afa0-5c43a51b4277

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-68669df9c4-hb58c_ac62d6fa-bfbe-41d5-afa0-5c43a51b4277 became leader

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-9c55b8cc4 from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6f89d9f6cc from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6f89d9f6cc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6f89d9f6ccrln44

openshift-ingress

replicaset-controller

kube-auth-proxy-9c55b8cc4

SuccessfulCreate

Created pod: kube-auth-proxy-9c55b8cc4-f2d66

openshift-ingress

replicaset-controller

kube-auth-proxy-9c55b8cc4

SuccessfulCreate

Created pod: kube-auth-proxy-9c55b8cc4-7pfgm

openshift-ingress

multus

kube-auth-proxy-9c55b8cc4-f2d66

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6f89d9f6ccrln44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

kube-auth-proxy-9c55b8cc4-7pfgm

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-7pfgm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-f2d66

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6f89d9f6ccrln44

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-qfgcb

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6f89d9f6ccrln44

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6f89d9f6ccrln44

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

multus

limitador-limitador-77dd99c685-8bwz6

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-77dd99c685 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulCreate

Created pod: limitador-limitador-77dd99c685-8bwz6

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-f2d66

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-7pfgm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.378s (2.378s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

limitador-limitador-77dd99c685-8bwz6

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulCreate

Created pod: authorino-74ccc46849-m6vxp

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-74ccc46849 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-7pfgm

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-7pfgm

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-f2d66

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-9c55b8cc4-f2d66

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.423s (2.423s including waiting). Image size: 188904677 bytes.

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-tf6tc

kuadrant-system

kubelet

limitador-limitador-77dd99c685-8bwz6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 1.111s (1.111s including waiting). Image size: 134933837 bytes.

kuadrant-system

kubelet

limitador-limitador-77dd99c685-8bwz6

Created

Container created

kuadrant-system

kubelet

limitador-limitador-77dd99c685-8bwz6

Started

Container started
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulCreate

Created pod: authorino-dc8775675-n5vjm

kuadrant-system

kubelet

authorino-74ccc46849-m6vxp

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-dc8775675 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-f7d6b5c7c

SuccessfulCreate

Created pod: limitador-limitador-f7d6b5c7c-n4z9t

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-f7d6b5c7c from 0 to 1

kuadrant-system

multus

authorino-74ccc46849-m6vxp

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x12)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-tf6tc

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-f7d6b5c7c-n4z9t

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-5tcnq

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-n4z9t

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-5tcnq

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf6tc

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

multus

authorino-dc8775675-n5vjm

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-dc8775675-n5vjm

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-d7cds

Created

Container created

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-d7cds

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90" in 9.219s (9.219s including waiting). Image size: 190254564 bytes.

kuadrant-system

kubelet

authorino-dc8775675-n5vjm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 1.614s (1.614s including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-d7cds

Started

Container started

kuadrant-system

kubelet

authorino-74ccc46849-m6vxp

Started

Container started

kuadrant-system

kubelet

authorino-74ccc46849-m6vxp

Created

Container created

kuadrant-system

kubelet

authorino-74ccc46849-m6vxp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 2.496s (2.496s including waiting). Image size: 208640811 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-5tcnq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

kubelet

authorino-dc8775675-n5vjm

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf6tc

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.59s (2.59s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

authorino-dc8775675-n5vjm

Created

Container created

kuadrant-system

developer-portal-controller-66d8dbb8c8-d7cds_5b83e0a0-b089-4cce-9bfd-487bb5509d47

6dd6d79d.kuadrant.io

LeaderElection

developer-portal-controller-66d8dbb8c8-d7cds_5b83e0a0-b089-4cce-9bfd-487bb5509d47 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-74ccc46849 from 1 to 0

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulDelete

Deleted pod: authorino-74ccc46849-m6vxp

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-5tcnq

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-5tcnq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.395s (2.395s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-5tcnq

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf6tc

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf6tc

Created

Container created

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-n4z9t

Created

Container created

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-n4z9t

Started

Container started

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-n4z9t

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 2.643s (2.643s including waiting). Image size: 134933837 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-76d5f9c5c-fb457

Killing

Stopping container manager

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-76d5f9c5c

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-76d5f9c5c-fb457

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-76d5f9c5c from 1 to 0

kuadrant-system

kubelet

authorino-74ccc46849-m6vxp

Killing

Stopping container authorino

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-tgr57

cert-manager

multus

cert-manager-597b95cb84-tgr57

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-tgr57

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

kubelet

cert-manager-597b95cb84-tgr57

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-tgr57

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.467s (2.467s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-tgr57

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-77dd99c685 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-77dd99c685-8bwz6

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulDelete

Deleted pod: limitador-limitador-77dd99c685-8bwz6

opendatahub

kserve-module-controller-manager-7566cf5fc8-5tcnq_b1d2df3f-f306-4e6e-836e-9ff0ed4b0f0e

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-5tcnq_b1d2df3f-f306-4e6e-836e-9ff0ed4b0f0e became leader

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-27c49_ba37eca6-2423-4365-918d-1a1fb4de9e6a

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-6b575997cc-27c49_ba37eca6-2423-4365-918d-1a1fb4de9e6a became leader

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

maas-controller-5456657644

SuccessfulCreate

Created pod: maas-controller-5456657644-j2hgt

opendatahub

multus

maas-controller-8689bcdb59-997v7

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5456657644 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-8689bcdb59 from 0 to 1

opendatahub

replicaset-controller

maas-controller-8689bcdb59

SuccessfulCreate

Created pod: maas-controller-8689bcdb59-997v7

opendatahub

kubelet

maas-controller-8689bcdb59-997v7

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:a964c3a9ac3ca915ee966a116051b81d2c3caee770799f00083467e8777c5c77"

opendatahub

kubelet

maas-controller-5456657644-j2hgt

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:a964c3a9ac3ca915ee966a116051b81d2c3caee770799f00083467e8777c5c77"

opendatahub

multus

maas-controller-5456657644-j2hgt

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-8689bcdb59-997v7

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:a964c3a9ac3ca915ee966a116051b81d2c3caee770799f00083467e8777c5c77" in 2.972s (2.972s including waiting). Image size: 200053270 bytes.

opendatahub

kubelet

maas-controller-8689bcdb59-997v7

Started

Container started

opendatahub

kubelet

maas-controller-5456657644-j2hgt

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:a964c3a9ac3ca915ee966a116051b81d2c3caee770799f00083467e8777c5c77" in 2.716s (2.716s including waiting). Image size: 200053270 bytes.

opendatahub

kubelet

maas-controller-5456657644-j2hgt

Created

Container created

opendatahub

kubelet

maas-controller-8689bcdb59-997v7

Created

Container created

opendatahub

kubelet

maas-controller-5456657644-j2hgt

Started

Container started

opendatahub

maas-controller-8689bcdb59-997v7_eb630890-aef1-4327-9863-ce6ce52c508e

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-8689bcdb59-997v7_eb630890-aef1-4327-9863-ce6ce52c508e became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-9mddx

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mddx

Created

Container created

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-6kc8h

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mddx

Started

Container started

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mddx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-9mddx

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-gtngp

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-xrlvs

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-d66qd

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xrlvs

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

odh-model-controller-769875db56-d66qd

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub

multus

model-serving-api-75bd89fdfc-6kc8h

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-xrlvs

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-gtngp

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-6kc8h

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

odh-model-controller-769875db56-d66qd

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-zkxdg

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-zkxdg

Killing

Stopping container discovery

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-gtngp

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-6kc8h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.704s (1.705s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-6kc8h

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xrlvs

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-6kc8h

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xrlvs

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.197s (2.197s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xrlvs

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-gtngp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.902s (2.902s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-d66qd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.439s (3.439s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-d66qd

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-gtngp

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-d66qd

Created

Container created

opendatahub

kserve-controller-manager-776cc66d47-xrlvs_6ea69513-7100-4a7a-8faa-86b8fb3e1640

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-xrlvs_6ea69513-7100-4a7a-8faa-86b8fb3e1640 became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-gtngp

Created

Container created

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-8689bcdb59 from 1 to 0

opendatahub

kubelet

maas-controller-8689bcdb59-997v7

Killing

Stopping container manager

opendatahub

odh-model-controller-769875db56-d66qd_cb59a2d9-4c07-4ee3-a469-657645fe0418

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-d66qd_cb59a2d9-4c07-4ee3-a469-657645fe0418 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-gtngp_359c2b5b-26e8-4779-a485-7d54fb7f49e9

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-gtngp_359c2b5b-26e8-4779-a485-7d54fb7f49e9 became leader

opendatahub

replicaset-controller

maas-controller-8689bcdb59

SuccessfulDelete

Deleted pod: maas-controller-8689bcdb59-997v7

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.308s (11.308s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-6xz9f

Created

Container created

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-bxm2p"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-xpc8x"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-68b94c7695 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-68b94c7695

SuccessfulCreate

Created pod: jobset-controller-manager-68b94c7695-hqsdp

openshift-jobset-operator

kubelet

jobset-controller-manager-68b94c7695-hqsdp

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-68b94c7695-hqsdp

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-68b94c7695-hqsdp

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-68b94c7695-hqsdp

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.584s (2.584s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-68b94c7695-hqsdp

Started

Container started

openshift-jobset-operator

jobset-controller-manager-68b94c7695-hqsdp_f87764f6-cb5b-4465-8199-66dba1f18850

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-68b94c7695-hqsdp_f87764f6-cb5b-4465-8199-66dba1f18850 became leader

opendatahub

maas-controller-5456657644-j2hgt_e3d76ab1-4efb-4237-99d1-44f5c62a7c03

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5456657644-j2hgt_e3d76ab1-4efb-4237-99d1-44f5c62a7c03 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-65db9f99d7 from 1 to 0

kuadrant-system

replicaset-controller

authorino-65db9f99d7

SuccessfulDelete

Deleted pod: authorino-65db9f99d7-gkmz2

kuadrant-system

replicaset-controller

authorino-76c7f55f9d

SuccessfulCreate

Created pod: authorino-76c7f55f9d-d5v59

kuadrant-system

kubelet

authorino-7597569d74-sknct

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulDelete

Deleted pod: authorino-7597569d74-sknct

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulCreate

Created pod: authorino-7597569d74-sknct

kuadrant-system

multus

authorino-7597569d74-sknct

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-65db9f99d7

SuccessfulCreate

Created pod: authorino-65db9f99d7-gkmz2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7597569d74 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-7597569d74 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-65db9f99d7 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-76c7f55f9d from 0 to 1

kuadrant-system

kubelet

authorino-76c7f55f9d-d5v59

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

authorino-7597569d74-sknct

Started

Container started

kuadrant-system

multus

authorino-76c7f55f9d-d5v59

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-7597569d74-sknct

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 771ms (771ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-7597569d74-sknct

Created

Container created

kuadrant-system

replicaset-controller

authorino-76c7f55f9d

SuccessfulDelete

Deleted pod: authorino-76c7f55f9d-d5v59

kuadrant-system

kubelet

authorino-7597569d74-sknct

Killing

Stopping container authorino

kuadrant-system

multus

authorino-55b8fd5845-fdl6z

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-76c7f55f9d from 1 to 0

kuadrant-system

replicaset-controller

authorino-55b8fd5845

SuccessfulCreate

Created pod: authorino-55b8fd5845-fdl6z

kuadrant-system

kubelet

authorino-55b8fd5845-fdl6z

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

authorino-76c7f55f9d-d5v59

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 623ms (623ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-76c7f55f9d-d5v59

Created

Container created

kuadrant-system

kubelet

authorino-76c7f55f9d-d5v59

Started

Container started

kuadrant-system

kubelet

authorino-76c7f55f9d-d5v59

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulDelete

Deleted pod: authorino-dc8775675-n5vjm

kuadrant-system

kubelet

authorino-dc8775675-n5vjm

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-55b8fd5845-fdl6z

Started

Container started

kuadrant-system

kubelet

authorino-55b8fd5845-fdl6z

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 285ms (285ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-55b8fd5845-fdl6z

Created

Container created
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-lw4w4

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-lw4w4

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-lw4w4

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-lw4w4

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-lw4w4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 341ms (341ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-lw4w4

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-67bf986f99 from 1 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-nrbjr

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-nrbjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-fhwtr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-p8z8x

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-nrbjr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-p8z8x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-fhwtr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-p8z8x

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-nrbjr

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-fhwtr

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-nrbjr

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-gtngp

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-gtngp

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-8pcnj

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8pcnj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-8pcnj

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-p8z8x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.557s (2.557s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-p8z8x

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-fhwtr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-p8z8x

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-fhwtr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-fhwtr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.49s (2.49s including waiting). Image size: 183555333 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8pcnj

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-8pcnj_75d1735d-6988-4bf2-9420-0ea8c27d9b0c

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-8pcnj_75d1735d-6988-4bf2-9420-0ea8c27d9b0c became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8pcnj

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8pcnj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.791s (1.791s including waiting). Image size: 183926184 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-znczm

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-nrbjr

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-nrbjr

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

multus

payload-processing-5f78687d5b-9l4x8

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-9l4x8

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-9l4x8

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-znczm
(x6)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-znczm

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-fhwtr

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-fhwtr

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-p8z8x

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-p8z8x

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-5f78687d5b-9l4x8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-znczm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-znczm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-znczm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.286s (2.286s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-9l4x8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.247s (2.247s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-9l4x8

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-qmzkh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-qmzkh

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-67bf986f99 from 4 to 5

opendatahub

multus

ai-gateway-controller-cf84bc4f4-dmpmz

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-cf84bc4f4 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-cf84bc4f4

SuccessfulCreate

Created pod: ai-gateway-controller-cf84bc4f4-dmpmz

opendatahub

kubelet

ai-gateway-controller-cf84bc4f4-dmpmz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-cf84bc4f4-dmpmz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 310ms (310ms including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-cf84bc4f4-dmpmz

Started

Container started

opendatahub

kubelet

ai-gateway-controller-cf84bc4f4-dmpmz

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused

opendatahub

llmisvc-controller-manager-6466c554d8-lw4w4_d3e1f4c2-f47b-4d0d-bf32-d323857b8f84

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-lw4w4_d3e1f4c2-f47b-4d0d-bf32-d323857b8f84 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-8pcnj

opendatahub

kubelet

ai-gateway-controller-7d85675f98-8pcnj

Killing

Stopping container manager

opendatahub

ai-gateway-controller-cf84bc4f4-dmpmz_1178fc07-275d-4f11-a4d4-cab0cb224c51

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-cf84bc4f4-dmpmz_1178fc07-275d-4f11-a4d4-cab0cb224c51 became leader

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.544s (1.544s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

Created

Container created

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.074s (1.075s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-nj9sw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 185ms (185ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-nj9sw

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-nj9sw

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-nj9sw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-nj9sw

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-nj9sw

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 820ms (820ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 222ms (222ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8q2zzc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-7mmmn

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

multus

echo-simulator-kserve-64b6f8f96c-7mmmn

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-7mmmn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 223ms (223ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-7mmmn

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-7mmmn

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-7mmmn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.874s (1.874s including waiting). Image size: 78208878 bytes.

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 234ms (234ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-cxsgh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-cntbh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-x4522

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-67bf986f99-9kmd2

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-cntbh

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-67bf986f99-wjstn

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-x4522

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-67bf986f99 from 5 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-wjstn

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-9kmd2

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-x4522

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-x4522

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-x4522

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-67bf986f99-cxsgh

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-x4522

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-x4522

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

kuadrant-system

replicaset-controller

authorino-75d56799cb

SuccessfulCreate

Created pod: authorino-75d56799cb-n8rw5

kuadrant-system

kubelet

authorino-75d56799cb-n8rw5

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

multus

authorino-75d56799cb-n8rw5

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x4)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-55b8fd5845 from 1 to 0

kuadrant-system

replicaset-controller

authorino-55b8fd5845

SuccessfulDelete

Deleted pod: authorino-55b8fd5845-fdl6z

kuadrant-system

kubelet

authorino-75d56799cb-n8rw5

Started

Container started

kuadrant-system

kubelet

authorino-75d56799cb-n8rw5

Created

Container created

kuadrant-system

kubelet

authorino-75d56799cb-n8rw5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 759ms (759ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-55b8fd5845-fdl6z

Killing

Stopping container authorino

openshift-ingress

replicaset-controller

e2e-ait-ce05c7ef-openshift-default-b9bb988f

SuccessfulCreate

Created pod: e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

openshift-ingress

gateway_labeler_controller

e2e-ait-ce05c7ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ce05c7ef

openshift-ingress

deployment-controller

e2e-ait-ce05c7ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ce05c7ef-openshift-default-b9bb988f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a8c61e05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a8c61e05

openshift-ingress

replicaset-controller

e2e-migrate-fd500666-gw-openshift-default-b5867b669

SuccessfulCreate

Created pod: e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

openshift-ingress

deployment-controller

e2e-migrate-fd500666-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-fd500666-gw-openshift-default-b5867b669 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a8c61e05-openshift-default-58cbc746dc

SuccessfulCreate

Created pod: e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

openshift-ingress

multus

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-fd500666-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-fd500666-gw

openshift-ingress

deployment-controller

e2e-ait-a8c61e05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a8c61e05-openshift-default-58cbc746dc from 0 to 1

openshift-ingress

multus

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a8c61e05: serviceaccount "payload-processing-e2e-ait-a8c61e05" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a8c61e05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a8c61e05-58c947cf67 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a8c61e05-7f949cc5dd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a8c61e05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a8c61e05-7f949cc5dd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a8c61e05-7f949cc5dd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a8c61e05-7f949cc5dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a8c61e05: serviceaccount "payload-processing-e2e-ait-a8c61e05" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ce05c7ef-59894df599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ce05c7ef-59894df599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ce05c7ef: serviceaccount "payload-processing-e2e-ait-ce05c7ef" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ce05c7ef-857cf887b6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ce05c7ef-857cf887b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ce05c7ef: serviceaccount "payload-processing-e2e-ait-ce05c7ef" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ce05c7ef-857cf887b6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ce05c7ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ce05c7ef-857cf887b6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ce05c7ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ce05c7ef-59894df599 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ce05c7ef-59894df599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8

openshift-ingress

kubelet

payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fd500666-64f88b9c86

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-fd500666

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-fd500666-64f88b9c86 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fd500666-64f88b9c86

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-fd500666-64f88b9c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fd500666: serviceaccount "payload-processing-e2e-migrate-fd500666" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fd500666: serviceaccount "payload-processing-e2e-migrate-fd500666" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-fd500666

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-fd500666-77cb9b7459 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-5e0da928

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-5e0da928

openshift-ingress

multus

payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4

Started

Container started

openshift-ingress

replicaset-controller

e2e-derive-5e0da928-openshift-default-6587d8f4df

SuccessfulCreate

Created pod: e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

openshift-ingress

deployment-controller

e2e-derive-5e0da928-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-5e0da928-openshift-default-6587d8f4df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-derive-5e0da928

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-5e0da928-7d8b7dddcb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-5e0da928

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-5e0da928-66b7947b4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5e0da928-7d8b7dddcb

SuccessfulCreate

Created pod: payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5e0da928-7d8b7dddcb

FailedCreate

Error creating: pods "payload-processing-e2e-derive-5e0da928-7d8b7dddcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5e0da928: serviceaccount "payload-processing-e2e-derive-5e0da928" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5e0da928: serviceaccount "payload-processing-e2e-derive-5e0da928" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-ait-a9a40825-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a9a40825-openshift-default-c6d9b777c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a9a40825-openshift-default-c6d9b777c

SuccessfulCreate

Created pod: e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

openshift-ingress

gateway_labeler_controller

e2e-ait-a9a40825

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a9a40825

openshift-ingress

multus

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a9a40825-7f544d65c4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a9a40825-7f544d65c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a9a40825: serviceaccount "payload-processing-e2e-ait-a9a40825" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a9a40825-84767fb78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a9a40825

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a9a40825-84767fb78c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a9a40825-84767fb78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a9a40825-84767fb78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a9a40825: serviceaccount "payload-processing-e2e-ait-a9a40825" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a9a40825

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a9a40825-7f544d65c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a9a40825-7f544d65c4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ce05c7ef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ce05c7ef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-fd500666-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a8c61e05-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a8c61e05-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-fd500666-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ce05c7ef-59894df599-q2kd8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ce05c7ef-857cf887b6-8knn4

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-5e0da928-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-5e0da928-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8c61e05-58c947cf67-f4f6f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a8c61e05-7f949cc5dd-9n6lk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ce05c7ef-openshift-default-b9bb988f-zsg2p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fd500666-77cb9b7459-wfnmq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.63:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-migrate-fd500666-64f88b9c86-s5h2f

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.64:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5e0da928-66b7947b4c-8lsn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-fd500666-gw-openshift-default-b5867b669-pg9kf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-6e8fca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-6e8fca

openshift-ingress

kubelet

payload-processing-e2e-derive-5e0da928-7d8b7dddcb-5q6z8

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

openshift-ingress

deployment-controller

e2e-worker-w2-6e8fca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6e8fca-openshift-default-77759666dc from 0 to 1

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-419d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-419d32-openshift-default-6d8ff84c79 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-419d32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-419d32

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-a8c61e05-openshift-default-58cbc746dc-mpsdt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-5e0da928-openshift-default-6587d8f4df-5mxzb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-b424a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-b424a5

openshift-ingress

deployment-controller

e2e-worker-w1-b424a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b424a5-openshift-default-6466f75c99 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-6e8fca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-6e8fca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-6e8fca-7df8c6d488 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-6e8fca: serviceaccount "payload-processing-e2e-worker-w2-6e8fca" not found

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-6e8fca: serviceaccount "payload-processing-e2e-worker-w2-6e8fca" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-419d32: serviceaccount "payload-processing-e2e-worker-w4-419d32" not found

openshift-ingress

deployment-controller

e2e-worker-w3-3cc458-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3cc458-openshift-default-75dc4c6579 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-419d32-6dff5c9996

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-419d32-6dff5c9996-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-419d32: serviceaccount "payload-processing-e2e-worker-w4-419d32" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-419d32-6dff5c9996

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-419d32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-419d32-6dff5c9996 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-3cc458

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-3cc458

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-419d32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

Started

Container started

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a9a40825-84767fb78c-2fk5b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a9a40825-7f544d65c4-gclds

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-b424a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-b424a5-b698d4bb8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-b424a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b424a5-b698d4bb8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b424a5: serviceaccount "payload-processing-e2e-worker-w1-b424a5" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-b424a5-b698d4bb8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-b424a5-b698d4bb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-b424a5: serviceaccount "payload-processing-e2e-worker-w1-b424a5" not found
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a9a40825-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a9a40825-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-3cc458-99565d668

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-3cc458-99565d668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-3cc458: serviceaccount "payload-processing-e2e-worker-w3-3cc458" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-3cc458

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-3cc458

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-3cc458-99565d668 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

openshift-ingress

multus

payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-3cc458-99565d668

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-3cc458: serviceaccount "payload-processing-e2e-worker-w3-3cc458" not found
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-9zh44

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9zh44

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-9zh44

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9zh44

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.171s (3.171s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

e2e-ait-a9a40825-openshift-default-c6d9b777c-qr8gk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9zh44

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9zh44

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9zh44

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9zh44

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-worker-w0-57ee15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-57ee15-openshift-default-b4df69477 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-57ee15

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-57ee15

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-57ee15

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-57ee15-7558957ff4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-57ee15-7558957ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-57ee15: serviceaccount "payload-processing-e2e-worker-w0-57ee15" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-57ee15: serviceaccount "payload-processing-e2e-worker-w0-57ee15" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-57ee15-7558957ff4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-57ee15

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-57ee15-7558957ff4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.543s (3.543s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.335s (3.335s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

openshift-ingress

deployment-controller

e2e-worker-w2-6e8fca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6e8fca-openshift-default-77759666dc from 1 to 3

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3cc458-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3cc458-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

openshift-ingress

deployment-controller

e2e-worker-w4-419d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-419d32-openshift-default-6d8ff84c79 from 1 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-b424a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b424a5-openshift-default-6466f75c99 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w2-6e8fca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6e8fca-openshift-default-77759666dc from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-57ee15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-57ee15-openshift-default-b4df69477 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

openshift-ingress

deployment-controller

e2e-worker-w4-419d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-419d32-openshift-default-6d8ff84c79 from 2 to 4

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3cc458-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-3cc458-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3cc458-openshift-default-75dc4c6579 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-b424a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b424a5-openshift-default-6466f75c99 from 2 to 3
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-57ee15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-57ee15-openshift-default-b4df69477 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

openshift-ingress

deployment-controller

e2e-worker-w2-6e8fca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6e8fca-openshift-default-77759666dc from 5 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

Created

Container created

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-419d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-419d32-openshift-default-6d8ff84c79 from 4 to 5
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

Created

Container created

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-b424a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b424a5-openshift-default-6466f75c99 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-3cc458-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3cc458-openshift-default-75dc4c6579 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3cc458-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-b424a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b424a5-openshift-default-6466f75c99 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Unhealthy

Readiness probe failed: Get "https://10.133.0.33:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3cc458-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-3cc458-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3cc458-openshift-default-75dc4c6579 from 3 to 4

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

Created

Container created

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-6e8fca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-6e8fca-openshift-default-77759666dc from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-6e8fca-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

openshift-ingress

replicaset-controller

e2e-worker-w2-6e8fca-openshift-default-77759666dc

SuccessfulCreate

Created pod: e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Created

Container created

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

openshift-ingress

deployment-controller

e2e-worker-w4-419d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-419d32-openshift-default-6d8ff84c79 from 5 to 7
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

openshift-ingress

replicaset-controller

e2e-worker-w1-b424a5-openshift-default-6466f75c99

SuccessfulCreate

Created pod: e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-b424a5-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-b424a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-b424a5-openshift-default-6466f75c99 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

Started

Container started

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-57ee15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-57ee15-openshift-default-b4df69477 from 4 to 5

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

openshift-ingress

deployment-controller

e2e-worker-w3-3cc458-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3cc458-openshift-default-75dc4c6579 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3cc458-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

openshift-ingress

deployment-controller

e2e-worker-w0-57ee15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-57ee15-openshift-default-b4df69477 from 5 to 6

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

Created

Container created

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

Started

Container started

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f
(x6)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-419d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-419d32-openshift-default-6d8ff84c79 from 7 to 9
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

Started

Container started

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-3cc458-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-3cc458-openshift-default-75dc4c6579 from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

openshift-ingress

replicaset-controller

e2e-worker-w3-3cc458-openshift-default-75dc4c6579

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-3cc458-openshift-default

SuccessfulRescale

New size: 10; reason:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

Created

Container created

openshift-ingress

multus

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-57ee15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-57ee15-openshift-default-b4df69477 from 6 to 9

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

Started

Container started

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

Started

Container started

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-419d32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-419d32-openshift-default-6d8ff84c79 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-419d32-openshift-default-6d8ff84c79

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-419d32-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-57ee15-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-57ee15-openshift-default-b4df69477

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

openshift-ingress

deployment-controller

e2e-worker-w0-57ee15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-57ee15-openshift-default-b4df69477 from 9 to 10

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

Started

Container started

openshift-ingress

multus

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Unhealthy

Liveness probe failed: Get "https://10.133.0.33:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-mt-c6b2120f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c6b2120f

openshift-ingress

replicaset-controller

e2e-mt-c6b2120f-openshift-default-bd58474f7

SuccessfulCreate

Created pod: e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

openshift-ingress

deployment-controller

e2e-mt-c6b2120f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c6b2120f-openshift-default-bd58474f7 from 0 to 1

openshift-ingress

multus

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Unhealthy

Readiness probe failed: Get "https://10.133.0.33:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6b2120f: serviceaccount "payload-processing-e2e-mt-c6b2120f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6b2120f-5666cb5864

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c6b2120f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c6b2120f-5666cb5864 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6b2120f-5666cb5864

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c6b2120f-5666cb5864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6b2120f: serviceaccount "payload-processing-e2e-mt-c6b2120f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c6b2120f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

openshift-ingress

multus

payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-a-c5891f-openshift-default-df5849fc7

SuccessfulCreate

Created pod: e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

openshift-ingress

deployment-controller

e2e-api-a-c5891f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c5891f-openshift-default-df5849fc7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-c5891f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c5891f

openshift-ingress

multus

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c5891f-7d94c4cd4b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c5891f-7d94c4cd4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5891f: serviceaccount "payload-processing-e2e-api-a-c5891f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c5891f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c5891f-7d94c4cd4b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c5891f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c5891f-7d94c4cd4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c5891f: serviceaccount "payload-processing-e2e-api-a-c5891f" not found

openshift-ingress

multus

payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-x4522

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-fhwtr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-fhwtr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-qmzkh

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-67bf986f99 from 10 to 7

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-x4522

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-qmzkh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-a-4c8e1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4c8e1a-openshift-default-574b7f7d9c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-4c8e1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4c8e1a

openshift-ingress

replicaset-controller

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c

SuccessfulCreate

Created pod: e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

openshift-ingress

multus

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4c8e1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4c8e1a-69c984459d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4c8e1a-69c984459d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4c8e1a-69c984459d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4c8e1a-69c984459d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4c8e1a: serviceaccount "payload-processing-e2e-api-a-4c8e1a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4c8e1a: serviceaccount "payload-processing-e2e-api-a-4c8e1a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4c8e1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-c5891f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c5891f-openshift-default-df5849fc7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c5891f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-c5891f-openshift-default-df5849fc7

SuccessfulCreate

Created pod: e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

Started

Container started

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4

Started

Container started

openshift-ingress

multus

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4

Created

Container created

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6b2120f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6b2120f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-api-b-0498d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0498d2-openshift-default-7cc774fc4f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-0498d2-openshift-default-7cc774fc4f

SuccessfulCreate

Created pod: e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

openshift-ingress

gateway_labeler_controller

e2e-api-b-0498d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0498d2

openshift-ingress

multus

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c5891f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c5891f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-0bdf03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0bdf03-openshift-default-6f6d647fb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-0bdf03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0bdf03

openshift-ingress

replicaset-controller

e2e-api-b-0bdf03-openshift-default-6f6d647fb5

SuccessfulCreate

Created pod: e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0498d2-556c6fbc4

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0498d2-556c6fbc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0498d2: serviceaccount "payload-processing-e2e-api-b-0498d2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th

openshift-ingress

multus

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0498d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0498d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0498d2-556c6fbc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0498d2-556c6fbc4

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0498d2: serviceaccount "payload-processing-e2e-api-b-0498d2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6b2120f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6b2120f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0bdf03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-p8z8x

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0bdf03-6d59ffdd86

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0bdf03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0bdf03-6d59ffdd86 from 0 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-67bf986f99 from 7 to 6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0bdf03: serviceaccount "payload-processing-e2e-api-b-0bdf03" not found

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-p8z8x

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0bdf03-6d59ffdd86

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0bdf03-6d59ffdd86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0bdf03: serviceaccount "payload-processing-e2e-api-b-0bdf03" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-47vdr

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0bdf03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0bdf03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-47vdr

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47vdr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47vdr

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47vdr

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47vdr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.786s (3.786s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47vdr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47vdr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-c5891f-7d94c4cd4b-b2w76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c5891f-5586d8fd8c-l2xvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4c8e1a-6b64f8b84c-d4b7c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4c8e1a-69c984459d-jwnj4

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4c8e1a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4c8e1a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-4gvxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-c5891f-openshift-default-df5849fc7-bqh7w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-api-a-c8f010-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c8f010-openshift-default-5dd944d9b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-c8f010

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c8f010

openshift-ingress

replicaset-controller

e2e-api-a-c8f010-openshift-default-5dd944d9b9

SuccessfulCreate

Created pod: e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

openshift-ingress

multus

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0498d2-556c6fbc4-qdbxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0498d2-5f45b48b8c-vv8th

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

Created

Container created

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

Created

Container created

openshift-ingress

multus

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-0bdf03-openshift-default-6f6d647fb5

SuccessfulCreate

Created pod: e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

Started

Container started

openshift-ingress

deployment-controller

e2e-api-b-0bdf03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0bdf03-openshift-default-6f6d647fb5 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0bdf03-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-b-0bdf03-openshift-default-6f6d647fb5

SuccessfulCreate

Created pod: e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-b-0bdf03-openshift-default-6f6d647fb5

SuccessfulCreate

Created pod: e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

openshift-ingress

multus

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

Started

Container started

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

Started

Container started

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

Created

Container created

openshift-ingress

multus

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-4c8e1a-openshift-default-574b7f7d9c-n8xh9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0498d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0498d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c8f010-6c8445bbdb

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c8f010

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c8f010-95b94dbdc from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c8f010-6c8445bbdb

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c8f010-6c8445bbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c8f010: serviceaccount "payload-processing-e2e-api-a-c8f010" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c8f010

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c8f010-6c8445bbdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c8f010: serviceaccount "payload-processing-e2e-api-a-c8f010" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

Created

Container created

openshift-ingress

deployment-controller

e2e-mt-c6b2120f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c6b2120f-openshift-default-bd58474f7 from 1 to 2

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6b2120f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x8)

openshift-ingress

kubelet

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

Started

Container started

openshift-ingress

multus

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp

Created

Container created

openshift-ingress

replicaset-controller

e2e-mt-c6b2120f-openshift-default-bd58474f7

SuccessfulCreate

Created pod: e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

ProbeError

Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

Unhealthy

Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0498d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0498d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0bdf03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0bdf03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0bdf03-55cf47bbf5-9grgf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0bdf03-6d59ffdd86-b25fq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-0498d2-openshift-default-7cc774fc4f-jdtrd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-da151d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-da151d

openshift-ingress

replicaset-controller

e2e-api-b-da151d-openshift-default-569bdf86bc

SuccessfulCreate

Created pod: e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

openshift-ingress

deployment-controller

e2e-api-b-da151d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-da151d-openshift-default-569bdf86bc from 0 to 1

openshift-ingress

multus

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-da151d-697b678888

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-da151d-697b678888-d8zsf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-da151d: serviceaccount "payload-processing-e2e-api-b-da151d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-da151d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-da151d-6cfcff59d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-da151d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-da151d-697b678888 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-da151d-697b678888

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-da151d-697b678888-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-da151d: serviceaccount "payload-processing-e2e-api-b-da151d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-da151d-697b678888-d8zsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-da151d-697b678888-d8zsf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-da151d-697b678888-d8zsf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-da151d-697b678888-d8zsf

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd

Created

Container created

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-ptrfc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

Unhealthy

Readiness probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-k9t5s

ProbeError

Readiness probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

Unhealthy

Readiness probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-92cmw

ProbeError

Readiness probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

Unhealthy

Readiness probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-0bdf03-openshift-default-6f6d647fb5-dqvjw

ProbeError

Readiness probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8f010-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8f010-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

Started

Container started

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6b2120f-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-c6b2120f-openshift-default-bd58474f7

SuccessfulCreate

Created pod: e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

openshift-ingress

deployment-controller

e2e-mt-c6b2120f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c6b2120f-openshift-default-bd58474f7 from 2 to 3

openshift-ingress

multus

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

Unhealthy

Startup probe failed: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

ProbeError

Startup probe error: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7325-632f59

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7325-632f59

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-632f59

Created

Container created

opendatahub

kubelet

test-curl-7325-632f59

Started

Container started

opendatahub

kubelet

test-curl-7325-632f59

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.967s (1.967s including waiting). Image size: 106100986 bytes.
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8f010-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c8f010-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7325-632f59

Killing

Stopping container test-curl-7325-632f59

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c8f010-6c8445bbdb-fxgzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c8f010-95b94dbdc-5885p

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.89:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-l4frw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-r6l4c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-853d3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-853d3a

openshift-ingress

deployment-controller

e2e-ipp-a-853d3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-853d3a-openshift-default-df76d986c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-853d3a-openshift-default-df76d986c

SuccessfulCreate

Created pod: e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

openshift-ingress

multus

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-da151d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-da151d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-ipp-a-064408-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-064408-openshift-default-747f9dd5ff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-064408

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-064408

openshift-ingress

replicaset-controller

e2e-ipp-a-064408-openshift-default-747f9dd5ff

SuccessfulCreate

Created pod: e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

openshift-ingress

multus

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-853d3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-853d3a: serviceaccount "payload-processing-e2e-ipp-a-853d3a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-853d3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-853d3a: serviceaccount "payload-processing-e2e-ipp-a-853d3a" not found
(x6)

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg

Started

Container started

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-c8f010-openshift-default-5dd944d9b9-4m4p2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-064408-6c67ff6bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-064408-6c67ff6bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-064408: serviceaccount "payload-processing-e2e-ipp-a-064408" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-064408-6c67ff6bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-064408

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-064408-75cbbbf795 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-064408: serviceaccount "payload-processing-e2e-ipp-a-064408" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-064408

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-064408-6c67ff6bd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c6b2120f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c6b2120f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c6b2120f-5666cb5864 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6b2120f-5666cb5864

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c6b2120f-5666cb5864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6b2120f: serviceaccount "payload-processing-e2e-mt-c6b2120f" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c6b2120f: serviceaccount "payload-processing-e2e-mt-c6b2120f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c6b2120f-5666cb5864

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c33ee4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c33ee4

openshift-ingress

replicaset-controller

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5

SuccessfulCreate

Created pod: e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

openshift-ingress

deployment-controller

e2e-ipp-a-c33ee4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c33ee4-openshift-default-859fdb69b5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da151d-6cfcff59d7-rqzfd

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-da151d-697b678888-d8zsf

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-da151d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-da151d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c33ee4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c33ee4-55db7948f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c33ee4: serviceaccount "payload-processing-e2e-ipp-a-c33ee4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c33ee4-55db7948f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c33ee4-55db7948f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c33ee4: serviceaccount "payload-processing-e2e-ipp-a-c33ee4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c33ee4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff from 0 to 1

opendatahub

kubelet

test-curl-7325-7cdd3a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c33ee4-55db7948f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69

opendatahub

multus

test-curl-7325-7cdd3a

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-7cdd3a

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw

Started

Container started

opendatahub

kubelet

test-curl-7325-7cdd3a

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7325-7cdd3a

Killing

Stopping container test-curl-7325-7cdd3a

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-77b4f9b8b4-999hg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-7bc6687fcf-jpj87

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-6c67ff6bd-8tznm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-75cbbbf795-jcxkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c6b2120f-5666cb5864-xmhnq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c6b2120f-55d49bcd99-8hk9k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d951c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d951c4

openshift-ingress

deployment-controller

e2e-ipp-a-d951c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d951c4-openshift-default-9f8559cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-d951c4-openshift-default-9f8559cf

SuccessfulCreate

Created pod: e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

openshift-ingress

multus

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-da151d-openshift-default-569bdf86bc-p9lhr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-853d3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-853d3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-853d3a: serviceaccount "payload-processing-e2e-ipp-a-853d3a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-853d3a: serviceaccount "payload-processing-e2e-ipp-a-853d3a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.498s (1.498s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.859s (1.859s including waiting). Image size: 166612641 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-064408

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-064408-c74cbb9f4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-064408

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-064408-c74cbb9f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-064408-c74cbb9f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-064408: serviceaccount "payload-processing-e2e-ipp-a-064408" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-064408: serviceaccount "payload-processing-e2e-ipp-a-064408" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-064408-c74cbb9f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25

openshift-ingress

multus

payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.301s (2.301s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d951c4: serviceaccount "payload-processing-e2e-ipp-a-d951c4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d951c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d951c4-fc6df759b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d951c4-fc6df759b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d951c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d951c4-fc6df759b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d951c4-fc6df759b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d951c4: serviceaccount "payload-processing-e2e-ipp-a-d951c4" not found
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

Unhealthy

Readiness probe failed: dial tcp 10.133.0.101:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-55db7948f4-tdt69

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-54fd497bff-btklw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

ProbeError

Readiness probe error: Get "http://10.133.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

Unhealthy

Readiness probe failed: Get "http://10.133.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c33ee4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c33ee4-66d46d6784 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c33ee4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c33ee4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c33ee4-66d46d6784

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c33ee4-66d46d6784-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c33ee4: serviceaccount "payload-processing-e2e-ipp-a-c33ee4" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c33ee4: serviceaccount "payload-processing-e2e-ipp-a-c33ee4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c33ee4-66d46d6784

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c33ee4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

Unhealthy

Readiness probe failed: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

ProbeError

Readiness probe error: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a8dc70

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a8dc70

openshift-ingress

deployment-controller

e2e-ipp-b-a8dc70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a8dc70-openshift-default-55d896d7f9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9

SuccessfulCreate

Created pod: e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

openshift-ingress

multus

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-c6b2120f-openshift-default-bd58474f7

SuccessfulCreate

Created pod: e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

openshift-ingress

deployment-controller

e2e-ipp-b-189cda-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-189cda-openshift-default-76776699c7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-189cda

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-189cda

openshift-ingress

deployment-controller

e2e-mt-c6b2120f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c6b2120f-openshift-default-bd58474f7 from 3 to 5

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

Started

Container started

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

Created

Container created

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-c6b2120f-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-b-189cda-openshift-default-76776699c7

SuccessfulCreate

Created pod: e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

openshift-ingress

replicaset-controller

e2e-mt-c6b2120f-openshift-default-bd58474f7

SuccessfulCreate

Created pod: e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

Started

Container started

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

Created

Container created

openshift-ingress

multus

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a8dc70: serviceaccount "payload-processing-e2e-ipp-b-a8dc70" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a8dc70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a8dc70: serviceaccount "payload-processing-e2e-ipp-b-a8dc70" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a8dc70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a8dc70-d9fb4d884 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-189cda-fc765d467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-189cda-fc765d467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-189cda: serviceaccount "payload-processing-e2e-ipp-b-189cda" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-189cda-fc765d467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-189cda

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-189cda-fc765d467 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-189cda-ffc578cd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-189cda-ffc578cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-189cda: serviceaccount "payload-processing-e2e-ipp-b-189cda" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-189cda-ffc578cd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-853d3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-853d3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-189cda

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-189cda-ffc578cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-064408-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-064408-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-069812-openshift-default-694cb7645c

SuccessfulCreate

Created pod: e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-069812

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-069812

openshift-ingress

deployment-controller

e2e-ipp-b-069812-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-069812-openshift-default-694cb7645c from 0 to 1

openshift-ingress

multus

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-7d498c4b75-rc9nq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-fc6df759b-5n268

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-wk6xf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-w6mcz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-zc68w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-khqcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c6b2120f-openshift-default-bd58474f7-lxhx8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-a3be60-openshift-default-5778b886dc

SuccessfulCreate

Created pod: e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

openshift-ingress

gateway_labeler_controller

e2e-api-a-a3be60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a3be60

openshift-ingress

deployment-controller

e2e-api-a-a3be60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a3be60-openshift-default-5778b886dc from 0 to 1

openshift-ingress

multus

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-853d3a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-853d3a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a3be60

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a3be60-55c8d87864 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a3be60-55c8d87864

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a3be60-55c8d87864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a3be60: serviceaccount "payload-processing-e2e-api-a-a3be60" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a3be60

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a3be60-cd57b57d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a3be60: serviceaccount "payload-processing-e2e-api-a-a3be60" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a3be60-55c8d87864

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c33ee4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c33ee4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-064408-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-064408-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-069812-568d478b79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-069812-568d478b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-069812: serviceaccount "payload-processing-e2e-ipp-b-069812" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-069812-568d478b79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-069812

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-069812-6988fd449d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-069812-6988fd449d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-069812-6988fd449d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-069812: serviceaccount "payload-processing-e2e-ipp-b-069812" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-069812

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-069812-568d478b79 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-069812-6988fd449d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d951c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d951c4-585867c47f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d951c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d951c4-b7d47848b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d951c4: serviceaccount "payload-processing-e2e-ipp-a-d951c4" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d951c4-b7d47848b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d951c4-b7d47848b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d951c4: serviceaccount "payload-processing-e2e-ipp-a-d951c4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d951c4-b7d47848b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-394a31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-394a31-openshift-default-7c846788c5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-394a31-openshift-default-7c846788c5

SuccessfulCreate

Created pod: e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-394a31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-394a31

openshift-ingress

multus

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-86dcff4487-4j59n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-d9fb4d884-4b2qs

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-394a31-75fc7b589b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-394a31-75fc7b589b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-394a31: serviceaccount "payload-processing-e2e-ipp-b-394a31" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-394a31-75fc7b589b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-394a31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-394a31-75fc7b589b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-394a31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-394a31: serviceaccount "payload-processing-e2e-ipp-b-394a31" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-ffc578cd-gfkwj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-fc765d467-mz9jx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a8dc70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a8dc70-bfb464d74 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a8dc70: serviceaccount "payload-processing-e2e-ipp-b-a8dc70" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a8dc70-bfb464d74

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a8dc70-bfb464d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a8dc70: serviceaccount "payload-processing-e2e-ipp-b-a8dc70" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a8dc70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a8dc70-bfb464d74

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-189cda-554fd54cb4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-189cda: serviceaccount "payload-processing-e2e-ipp-b-189cda" not found

openshift-ingress

replicaset-controller

e2e-ipp-b-189cda-openshift-default-76776699c7

SuccessfulCreate

Created pod: e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

openshift-ingress

deployment-controller

e2e-ipp-b-189cda-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-189cda-openshift-default-76776699c7 from 1 to 3

openshift-ingress

replicaset-controller

e2e-ipp-b-189cda-openshift-default-76776699c7

SuccessfulCreate

Created pod: e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-189cda-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-189cda-554fd54cb4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-189cda-554fd54cb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-189cda: serviceaccount "payload-processing-e2e-ipp-b-189cda" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-189cda

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-189cda-755bc9b467 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-189cda

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-189cda-554fd54cb4 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a3be60-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-6988fd449d-w6m5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

Unhealthy

Readiness probe failed: Get "http://10.133.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

ProbeError

Readiness probe error: Get "http://10.133.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a3be60-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

Started

Container started

openshift-ingress

multus

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-b-e0bc49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e0bc49

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-568d478b79-zqmrn

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg

Created

Container created

openshift-ingress

deployment-controller

e2e-api-b-e0bc49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e0bc49-openshift-default-664fcbfd9 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

ProbeError

Readiness probe error: Get "http://10.133.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-api-b-e0bc49-openshift-default-664fcbfd9

SuccessfulCreate

Created pod: e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x
(x6)

openshift-ingress

kubelet

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

Unhealthy

Readiness probe failed: Get "http://10.133.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

ProbeError

Readiness probe error: Get "http://10.133.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

Unhealthy

Readiness probe failed: Get "http://10.133.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e0bc49-76544fffcd

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e0bc49-76544fffcd

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e0bc49-76544fffcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e0bc49: serviceaccount "payload-processing-e2e-api-b-e0bc49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e0bc49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e0bc49-7b47578bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e0bc49: serviceaccount "payload-processing-e2e-api-b-e0bc49" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e0bc49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e0bc49-76544fffcd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.212s (2.212s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d951c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d951c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-189cda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-189cda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a3be60-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a3be60-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-064408-c74cbb9f4-sct25

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-064408-747dfd9bf9-cj7zz

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-069812: serviceaccount "payload-processing-e2e-ipp-b-069812" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-069812

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-069812-5fc46c9879 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-069812-7cd7895d76

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-069812-7cd7895d76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-069812: serviceaccount "payload-processing-e2e-ipp-b-069812" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-069812-7cd7895d76

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-069812

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-069812-7cd7895d76 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-069812-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-069812-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a8dc70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a8dc70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-189cda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-189cda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-75fc7b589b-jczbf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-6d66c9c58c-vsvxg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-064408-openshift-default-747f9dd5ff-pd7lp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-67bf986f99 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-9kmd2
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-l7hkg

Pulled

Container image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-l7hkg

Started

Container started
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-l7hkg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-9kmd2

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a8dc70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-069812-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a8dc70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-069812-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-853d3a-5dbcc7fb74-w5g67

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-853d3a-d5df8bc9-k4tss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-853d3a-openshift-default-df76d986c-g6mkl

Killing

Stopping container istio-proxy

kuadrant-system

dns-operator-controller-manager-57f5c66455-l7hkg_dbc619ca-713e-4603-9ed8-ac045ec2f6d5

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-57f5c66455-l7hkg_dbc619ca-713e-4603-9ed8-ac045ec2f6d5 became leader

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-394a31-7d9db95ddb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-394a31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-394a31-7d9db95ddb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-394a31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-394a31-7d9db95ddb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-394a31-7d9db95ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-394a31: serviceaccount "payload-processing-e2e-ipp-b-394a31" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-394a31: serviceaccount "payload-processing-e2e-ipp-b-394a31" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d951c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d951c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c33ee4-66d46d6784-rqlx7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c33ee4-5c485df94c-2bjtr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

Unhealthy

Readiness probe failed: dial tcp 10.134.0.150:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-c33ee4-openshift-default-859fdb69b5-m5vnl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-189cda-755bc9b467-jdqjg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-189cda-554fd54cb4-ndrgf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

ProbeError

Readiness probe error: Get "http://10.132.0.132:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Unhealthy

Readiness probe failed: Get "http://10.132.0.132:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-29gn6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

ProbeError

Readiness probe error: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

Unhealthy

Readiness probe failed: Get "http://10.132.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-q9wvz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-189cda-openshift-default-76776699c7-ttbkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-praxis-a-d42172-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d42172-openshift-default-78d859f857 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-a-d42172-openshift-default-78d859f857

SuccessfulCreate

Created pod: e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d42172

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d42172
(x2)

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a3be60-cd57b57d7-fnl2f

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-a3be60-55c8d87864-g8q8d

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8dc70-bfb464d74-l4lmt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8dc70-6bdcf74655-2mmdp

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-069812-5fc46c9879-vzjtw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-069812-7cd7895d76-jcm7f

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d42172

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d42172-9c865cb64 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d42172

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d42172-54484dd44c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d42172-9c865cb64

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d42172-9c865cb64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d42172: serviceaccount "payload-processing-e2e-praxis-a-d42172" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d42172: serviceaccount "payload-processing-e2e-praxis-a-d42172" not found

openshift-ingress

kubelet

e2e-ipp-b-a8dc70-openshift-default-55d896d7f9-jr2lx

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d42172-9c865cb64

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-069812-openshift-default-694cb7645c-phdtb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ca5f33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ca5f33

openshift-ingress

deployment-controller

e2e-praxis-a-ca5f33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ca5f33-openshift-default-77f699797c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-ca5f33-openshift-default-77f699797c

SuccessfulCreate

Created pod: e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ef208a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ef208a

openshift-ingress

replicaset-controller

e2e-praxis-a-ef208a-openshift-default-6594775cd5

SuccessfulCreate

Created pod: e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

openshift-ingress

deployment-controller

e2e-praxis-a-ef208a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ef208a-openshift-default-6594775cd5 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ca5f33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ca5f33-54dcbfd498 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ca5f33: serviceaccount "payload-processing-e2e-praxis-a-ca5f33" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ca5f33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ca5f33: serviceaccount "payload-processing-e2e-praxis-a-ca5f33" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ef208a: serviceaccount "payload-processing-e2e-praxis-a-ef208a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ef208a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ef208a: serviceaccount "payload-processing-e2e-praxis-a-ef208a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ef208a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-a3be60-openshift-default-5778b886dc-d6mmg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ef208a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ef208a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d951c4-585867c47f-xwhmt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d951c4-b7d47848b-vjnlv

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e0bc49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e0bc49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-394a31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-394a31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-d951c4-openshift-default-9f8559cf-5w9ww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e0bc49-7b47578bc-pwswt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e0bc49-76544fffcd-fxqwz

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-praxis-b-7ffac8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-7ffac8-openshift-default-767586db6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-7ffac8-openshift-default-767586db6f

SuccessfulCreate

Created pod: e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-7ffac8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-7ffac8

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b8b654

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b8b654

openshift-ingress

replicaset-controller

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5

SuccessfulCreate

Created pod: e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

openshift-ingress

deployment-controller

e2e-praxis-b-b8b654-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b8b654-openshift-default-68f8b94cb5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-394a31-758c6cf78c-glwf2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-394a31-7d9db95ddb-8xl6n

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b8b654: serviceaccount "payload-processing-e2e-praxis-b-b8b654" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b8b654

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b8b654

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b8b654-6c7556f4cb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b8b654: serviceaccount "payload-processing-e2e-praxis-b-b8b654" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-77db82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-77db82

openshift-ingress

deployment-controller

e2e-ipp-a-77db82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-77db82-openshift-default-5cc97b9779 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-e0bc49-openshift-default-664fcbfd9-j2n7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-394a31-openshift-default-7c846788c5-sgpx6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-1fae38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-1fae38

openshift-ingress

replicaset-controller

e2e-praxis-a-1fae38-openshift-default-754ffb8497

SuccessfulCreate

Created pod: e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

openshift-ingress

deployment-controller

e2e-praxis-a-1fae38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1fae38-openshift-default-754ffb8497 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7ffac8: serviceaccount "payload-processing-e2e-praxis-b-7ffac8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7ffac8: serviceaccount "payload-processing-e2e-praxis-b-7ffac8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-7ffac8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-7ffac8-6d59c957dd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-7ffac8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5

Started

Container started

openshift-ingress

multus

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8b654-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8b654-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1fae38: serviceaccount "payload-processing-e2e-praxis-a-1fae38" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-1fae38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-1fae38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-1fae38-d874c668 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1fae38-d874c668

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1fae38-d874c668

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-1fae38-d874c668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1fae38: serviceaccount "payload-processing-e2e-praxis-a-1fae38" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7ffac8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7ffac8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-77db82-54bd486f48

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-77db82-54bd486f48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-77db82: serviceaccount "payload-processing-e2e-ipp-a-77db82" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-77db82-54bd486f48

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-77db82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-77db82-54bd486f48 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-77db82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-77db82-546655d4c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-77db82: serviceaccount "payload-processing-e2e-ipp-a-77db82" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr

openshift-ingress

multus

payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d42172-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d42172-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca5f33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca5f33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-b-c2b103-openshift-default-696dd44677

SuccessfulCreate

Created pod: e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

openshift-ingress

deployment-controller

e2e-praxis-b-c2b103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c2b103-openshift-default-696dd44677 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-c2b103

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-c2b103

openshift-ingress

multus

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c2b103-56bf674948

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-c2b103-56bf674948-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c2b103: serviceaccount "payload-processing-e2e-praxis-b-c2b103" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-c2b103

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-c2b103-56bf674948 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-c2b103

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c2b103: serviceaccount "payload-processing-e2e-praxis-b-c2b103" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c2b103-56bf674948

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d42172-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d42172-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ef208a-6c5cd4b4d-wrtmz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ef208a-9ccb8d8f5-jqhpw

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca5f33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca5f33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c2b103-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c2b103-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-b-42fad7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-42fad7-openshift-default-75699fd96f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-42fad7-openshift-default-75699fd96f

SuccessfulCreate

Created pod: e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-42fad7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-42fad7

openshift-ingress

kubelet

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

Created

Container created

openshift-ingress

multus

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d42172-9c865cb64-pbn85

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d42172-54484dd44c-nn9fs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ef208a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ef208a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

kubelet

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-praxis-a-ef208a-openshift-default-6594775cd5-7glss

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c2b103-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c2b103-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42fad7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42fad7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-42fad7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-42fad7: serviceaccount "payload-processing-e2e-praxis-b-42fad7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-42fad7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-42fad7-78f7c686db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-42fad7-78f7c686db

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-42fad7-78f7c686db

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-42fad7-78f7c686db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-42fad7: serviceaccount "payload-processing-e2e-praxis-b-42fad7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

FailedCreatePodSandBox

Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9_openshift-ingress_46eee9bc-87c0-4421-92e7-547a494dbf3c_0(d75d960a160af4bea03dcedd145f128706b40b551b94c8fe91931bd6bd7f6e2c): error adding pod openshift-ingress_payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"d75d960a160af4bea03dcedd145f128706b40b551b94c8fe91931bd6bd7f6e2c" Netns:"/var/run/netns/e7ebec11-2073-424b-9fd8-33762f48750e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress;K8S_POD_NAME=payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9;K8S_POD_INFRA_CONTAINER_ID=d75d960a160af4bea03dcedd145f128706b40b551b94c8fe91931bd6bd7f6e2c;K8S_POD_UID=46eee9bc-87c0-4421-92e7-547a494dbf3c" Path:"" ERRORED: error configuring pod [openshift-ingress/payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9] networking: Multus: [openshift-ingress/payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9/46eee9bc-87c0-4421-92e7-547a494dbf3c]: error waiting for pod: Get "https://abc2cf8bc225b427fb144199fe91b720-31e182ef057dd652.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/pods/payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9?timeout=1m0s": context deadline exceeded ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

FailedCreatePodSandBox

Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl_openshift-ingress_6a166721-a635-4df9-adfe-7887eb5e7b39_0(e456e9e15295ab889301780c08c609e811a99205ef2bfe0faba296e12e30cfa1): error adding pod openshift-ingress_payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e456e9e15295ab889301780c08c609e811a99205ef2bfe0faba296e12e30cfa1" Netns:"/var/run/netns/fd269dd5-e2eb-4dc8-8e24-9efa79cb7d1d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress;K8S_POD_NAME=payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl;K8S_POD_INFRA_CONTAINER_ID=e456e9e15295ab889301780c08c609e811a99205ef2bfe0faba296e12e30cfa1;K8S_POD_UID=6a166721-a635-4df9-adfe-7887eb5e7b39" Path:"" ERRORED: error configuring pod [openshift-ingress/payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl] networking: Multus: [openshift-ingress/payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl/6a166721-a635-4df9-adfe-7887eb5e7b39]: error waiting for pod: Get "https://abc2cf8bc225b427fb144199fe91b720-31e182ef057dd652.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/pods/payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl?timeout=1m0s": context deadline exceeded ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8b654-78678d94b7-nm799

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

FailedCreatePodSandBox

Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9_openshift-ingress_46eee9bc-87c0-4421-92e7-547a494dbf3c_0(f584d7d5632cae08389973a4dc0ca6e9595e42f08f317ca8747581adbd235f55): error adding pod openshift-ingress_payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f584d7d5632cae08389973a4dc0ca6e9595e42f08f317ca8747581adbd235f55" Netns:"/var/run/netns/db94b451-ae31-4917-9102-e84913bcc7c8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress;K8S_POD_NAME=payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9;K8S_POD_INFRA_CONTAINER_ID=f584d7d5632cae08389973a4dc0ca6e9595e42f08f317ca8747581adbd235f55;K8S_POD_UID=46eee9bc-87c0-4421-92e7-547a494dbf3c" Path:"" ERRORED: error configuring pod [openshift-ingress/payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9] networking: Multus: [openshift-ingress/payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9/46eee9bc-87c0-4421-92e7-547a494dbf3c]: error waiting for pod: Get "https://abc2cf8bc225b427fb144199fe91b720-31e182ef057dd652.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/pods/payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9?timeout=1m0s": context deadline exceeded ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8b654-6c7556f4cb-8prx6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-d42172-openshift-default-78d859f857-fx24q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42fad7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-42fad7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-rrpjm

Unhealthy

Readiness probe failed: Get "https://10.134.0.52:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nphc9

Unhealthy

Readiness probe failed: Get "https://10.134.0.55:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7ffac8-6d59c957dd-qplqj

Killing

Stopping container payload-processing
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

ProbeError

Readiness probe error: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

Unhealthy

Readiness probe failed: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7ffac8-fd6b99659-kp2l5

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

ProbeError

Readiness probe error: Get "http://10.134.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

ProbeError

Readiness probe error: Get "http://10.134.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

Unhealthy

Readiness probe failed: Get "http://10.134.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

Unhealthy

Readiness probe failed: Get "http://10.134.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

Created

Container created

openshift-ingress

replicaset-controller

e2e-praxis-b-c2b103-openshift-default-696dd44677

SuccessfulCreate

Created pod: e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c2b103-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-b-b8b654-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b8b654-openshift-default-68f8b94cb5 from 1 to 2

openshift-ingress

deployment-controller

e2e-praxis-b-c2b103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c2b103-openshift-default-696dd44677 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8b654-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5

SuccessfulCreate

Created pod: e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-c2b103-openshift-default-696dd44677

SuccessfulCreate

Created pod: e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

openshift-ingress

multus

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

Unhealthy

Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

ProbeError

Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

Unhealthy

Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

ProbeError

Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

Unhealthy

Readiness probe failed: Get "http://10.133.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

Unhealthy

Readiness probe failed: Get "http://10.133.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

ProbeError

Readiness probe error: Get "http://10.133.0.127:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

ProbeError

Readiness probe error: Get "http://10.133.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-praxis-b-7ffac8-openshift-default-767586db6f

SuccessfulCreate

Created pod: e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

openshift-ingress

replicaset-controller

e2e-praxis-b-7ffac8-openshift-default-767586db6f

SuccessfulCreate

Created pod: e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

openshift-ingress

deployment-controller

e2e-praxis-b-7ffac8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-7ffac8-openshift-default-767586db6f from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7ffac8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

Unhealthy

Readiness probe failed: Get "http://10.133.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

ProbeError

Readiness probe error: Get "http://10.133.0.129:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

ProbeError

Readiness probe error: Get "http://10.133.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-praxis-b-c2b103-openshift-default-696dd44677

SuccessfulCreate

Created pod: e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

openshift-ingress

deployment-controller

e2e-praxis-b-c2b103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c2b103-openshift-default-696dd44677 from 3 to 6

openshift-ingress

replicaset-controller

e2e-praxis-b-c2b103-openshift-default-696dd44677

SuccessfulCreate

Created pod: e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

openshift-ingress

replicaset-controller

e2e-praxis-b-c2b103-openshift-default-696dd44677

SuccessfulCreate

Created pod: e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c2b103-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

Unhealthy

Readiness probe failed: Get "http://10.133.0.130:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5

SuccessfulCreate

Created pod: e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj

openshift-ingress

replicaset-controller

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5

SuccessfulCreate

Created pod: e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8b654-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-b-b8b654-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b8b654-openshift-default-68f8b94cb5 from 2 to 4
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-vjnrg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-ipp-a-77db82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-77db82-openshift-default-5cc97b9779 from 1 to 4

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-77db82-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-l7czl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7

Created

Container created

openshift-ingress

multus

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-tdkh7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-b8b654-openshift-default-68f8b94cb5-8xnhj

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

Started

Container started

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

Unhealthy

Startup probe failed: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

ProbeError

Startup probe error: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1fae38-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-54bd486f48-6dv4g

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1fae38-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-546655d4c5-knrgr

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

ProbeError

Startup probe error: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

Unhealthy

Startup probe failed: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

ProbeError

Startup probe error: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

Unhealthy

Startup probe failed: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

ProbeError

Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

Unhealthy

Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kl72t

Killing

Stopping container istio-proxy
(x11)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7ffac8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-kp62j

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-7ffac8-openshift-default-767586db6f-zndwg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7ffac8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x12)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c2b103-openshift-default

SuccessfulRescale

New size: 7; reason:
(x13)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-praxis-b-c2b103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c2b103-openshift-default-696dd44677 from 6 to 7

openshift-ingress

replicaset-controller

e2e-praxis-b-c2b103-openshift-default-696dd44677

SuccessfulCreate

Created pod: e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq
(x13)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

Created

Container created
(x13)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:

openshift-ingress

multus

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-67bf986f99 from 5 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-cntbh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca5f33-54dcbfd498-fvclr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca5f33-546df68d7-nnnlz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cntbh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-77db82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-77db82-69799db966 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-77db82-69799db966

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-77db82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-77db82: serviceaccount "payload-processing-e2e-ipp-a-77db82" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-77db82-69799db966

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-77db82-69799db966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-77db82: serviceaccount "payload-processing-e2e-ipp-a-77db82" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-77db82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-77db82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1fae38-d874c668-m42lh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1fae38-6b77fbf575-d99xj

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1fae38-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1fae38-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-1fae38-openshift-default-754ffb8497-4ctbx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ca5f33-openshift-default-77f699797c-gdcrs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-77db82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-77db82-openshift-default-5cc97b9779 from 4 to 6

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-77db82-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-602e18-openshift-default-77b95fd77

SuccessfulCreate

Created pod: e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

openshift-ingress

deployment-controller

e2e-ipp-b-602e18-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-602e18-openshift-default-77b95fd77 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-602e18

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-602e18

openshift-ingress

multus

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

ProbeError

Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Unhealthy

Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-602e18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-602e18-66f64c68db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-602e18-66f64c68db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-602e18-66f64c68db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-602e18-66f64c68db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-602e18: serviceaccount "payload-processing-e2e-ipp-b-602e18" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-602e18: serviceaccount "payload-processing-e2e-ipp-b-602e18" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-602e18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c2b103-56bf674948-7bb2m

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.133:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c2b103-6dbb5dfd79-tjljr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.132:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-42fad7-8495f45cf-md2x9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-42fad7-78f7c686db-wxcwl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-86gh7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-kvggs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-8ncgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-zds8c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-xbknk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-ckkps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-c2b103-openshift-default-696dd44677-knfgx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-66f64c68db-q5x68

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-6f78c8fc5f-p5dft

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-42fad7-openshift-default-75699fd96f-6sqks

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-602e18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-602e18-679cf796b4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-602e18-864cf77955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-602e18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-602e18-864cf77955 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-602e18-679cf796b4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-602e18-864cf77955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-602e18-864cf77955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-602e18: serviceaccount "payload-processing-e2e-ipp-b-602e18" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-602e18-679cf796b4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-602e18-679cf796b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-602e18: serviceaccount "payload-processing-e2e-ipp-b-602e18" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-602e18-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-602e18-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-602e18-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-602e18-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-77db82-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-77db82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-77db82-openshift-default-5cc97b9779 from 6 to 7

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-ac632e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-ac632e

openshift-ingress

deployment-controller

e2e-shared-a-w0-ac632e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-ac632e-openshift-default-c98c999 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-ac632e-openshift-default-c98c999

SuccessfulCreate

Created pod: e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

openshift-ingress

multus

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-ac632e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-ac632e: serviceaccount "payload-processing-e2e-shared-a-w0-ac632e" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-ac632e: serviceaccount "payload-processing-e2e-shared-a-w0-ac632e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-ac632e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-a2a10a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-a2a10a

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c

SuccessfulCreate

Created pod: e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

openshift-ingress

deployment-controller

e2e-shared-a-w2-a2a10a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-a2a10a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-a2a10a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-a2a10a-c7c86844 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a2a10a: serviceaccount "payload-processing-e2e-shared-a-w2-a2a10a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a2a10a: serviceaccount "payload-processing-e2e-shared-a-w2-a2a10a" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-e77b1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-e77b1d

openshift-ingress

replicaset-controller

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5

SuccessfulCreate

Created pod: e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf

SuccessfulCreate

Created pod: e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

openshift-ingress

deployment-controller

e2e-shared-a-w3-e77b1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-50e9fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-50e9fc

openshift-ingress

multus

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w4-50e9fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e77b1d: serviceaccount "payload-processing-e2e-shared-a-w3-e77b1d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-e77b1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-e77b1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e77b1d: serviceaccount "payload-processing-e2e-shared-a-w3-e77b1d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-50e9fc: serviceaccount "payload-processing-e2e-shared-a-w4-50e9fc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-50e9fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-50e9fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-50e9fc: serviceaccount "payload-processing-e2e-shared-a-w4-50e9fc" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97

SuccessfulCreate

Created pod: e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

openshift-ingress

deployment-controller

e2e-shared-b-w0-5cb3d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-5cb3d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-5cb3d5

openshift-ingress

multus

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-5cb3d5: serviceaccount "payload-processing-e2e-shared-b-w0-5cb3d5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-5cb3d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-5cb3d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-5cb3d5: serviceaccount "payload-processing-e2e-shared-b-w0-5cb3d5" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b00d69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b00d69

openshift-ingress

deployment-controller

e2e-shared-b-w2-b00d69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b00d69-openshift-default-6556c878f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b00d69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b00d69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4 from 0 to 1
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

ProbeError

Readiness probe error: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b00d69: serviceaccount "payload-processing-e2e-shared-b-w2-b00d69" not found
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

Unhealthy

Readiness probe failed: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b00d69: serviceaccount "payload-processing-e2e-shared-b-w2-b00d69" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Unhealthy

Readiness probe failed: Get "https://10.133.0.30:8000/ready": context deadline exceeded
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

Unhealthy

Readiness probe failed: Get "http://10.134.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

Unhealthy

Readiness probe failed: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

ProbeError

Readiness probe error: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

ProbeError

Readiness probe error: Get "http://10.134.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

ProbeError

Readiness probe error: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Unhealthy

Readiness probe failed: Get "http://10.134.0.180:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

ProbeError

Readiness probe error: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Unhealthy

Readiness probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b00d69-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b00d69-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff

SuccessfulCreate

Created pod: e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-c8eef3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-c8eef3

openshift-ingress

deployment-controller

e2e-shared-b-w3-c8eef3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc

Created

Container created

openshift-ingress

multus

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c

SuccessfulCreate

Created pod: e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a2a10a-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c

SuccessfulCreate

Created pod: e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

openshift-ingress

multus

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-a2a10a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c from 1 to 3

openshift-ingress

multus

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Unhealthy

Readiness probe failed: Get "http://10.133.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

ProbeError

Readiness probe error: Get "http://10.133.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

Unhealthy

Readiness probe failed: Get "http://10.133.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

ProbeError

Readiness probe error: Get "http://10.133.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

Unhealthy

Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-77db82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-77db82-openshift-default-5cc97b9779 from 7 to 8

openshift-ingress

replicaset-controller

e2e-ipp-a-77db82-openshift-default-5cc97b9779

SuccessfulCreate

Created pod: e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

ProbeError

Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-77db82-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-3b8bf3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-3b8bf3

openshift-ingress

replicaset-controller

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7

SuccessfulCreate

Created pod: e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

openshift-ingress

deployment-controller

e2e-shared-b-w4-3b8bf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-c8eef3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-c8eef3-59f868587b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-c8eef3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c8eef3: serviceaccount "payload-processing-e2e-shared-b-w3-c8eef3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c8eef3: serviceaccount "payload-processing-e2e-shared-b-w3-c8eef3" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e77b1d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e77b1d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Unhealthy

Startup probe failed: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

ProbeError

Startup probe error: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-50e9fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-50e9fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

ProbeError

Startup probe error: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

Unhealthy

Startup probe failed: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

ProbeError

Startup probe error: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

Unhealthy

Startup probe failed: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a2a10a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a2a10a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-3b8bf3: serviceaccount "payload-processing-e2e-shared-b-w4-3b8bf3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-3b8bf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-3b8bf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-3b8bf3: serviceaccount "payload-processing-e2e-shared-b-w4-3b8bf3" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c8eef3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c8eef3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e77b1d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-50e9fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e77b1d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-50e9fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a2a10a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a2a10a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x68)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Unhealthy

Readiness probe failed: Get "https://10.133.0.33:8000/ready": context deadline exceeded
(x4)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

Unhealthy

Readiness probe failed: Get "http://10.134.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

ProbeError

Readiness probe error: Get "http://10.134.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

Unhealthy

Readiness probe failed: Get "https://10.133.0.31:8000/ready": context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5cb3d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5cb3d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ac632e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ac632e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

ProbeError

Startup probe error: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

Unhealthy

Startup probe failed: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5cb3d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5cb3d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-67bf986f99 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-h2gf2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-h2gf2

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ac632e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ac632e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-3b8bf3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-3b8bf3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-77db82-5f65f58c47-fxmfw

Unhealthy

Readiness probe failed: dial tcp 10.133.0.138:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-77db82-69799db966-g2qw6

Unhealthy

Readiness probe failed: dial tcp 10.133.0.139:9004: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b00d69-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

openshift-ingress

deployment-controller

e2e-shared-b-w2-b00d69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b00d69-openshift-default-6556c878f5 from 1 to 4

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

Started

Container started

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-hw24f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-cq9n8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w4-3b8bf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7 from 1 to 2

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-ll5wx

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

Unhealthy

Startup probe failed: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7

SuccessfulCreate

Created pod: e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-6tpkg

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

ProbeError

Startup probe error: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-3b8bf3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-5cb3d5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w0-5cb3d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97

SuccessfulCreate

Created pod: e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-sbn78

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

ProbeError

Startup probe error: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e77b1d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w0-ac632e-openshift-default-c98c999

SuccessfulCreate

Created pod: e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

Unhealthy

Startup probe failed: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf

SuccessfulCreate

Created pod: e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-2jvc9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-wsfnw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-77db82-openshift-default-5cc97b9779-mgqqj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w3-e77b1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ac632e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w0-ac632e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-ac632e-openshift-default-c98c999 from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

Created

Container created

openshift-ingress

multus

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

ProbeError

Startup probe error: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

Unhealthy

Startup probe failed: Get "http://10.132.0.204:15021/healthz/ready": dial tcp 10.132.0.204:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

ProbeError

Startup probe error: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

Unhealthy

Startup probe failed: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-602e18-679cf796b4-7j4m9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-602e18-864cf77955-x2nrk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-602e18-openshift-default-77b95fd77-7q2jz

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b00d69-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b00d69-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ac422f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ac422f

openshift-ingress

replicaset-controller

e2e-praxis-a-ac422f-openshift-default-5cb78544d9

SuccessfulCreate

Created pod: e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

openshift-ingress

deployment-controller

e2e-praxis-a-ac422f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ac422f-openshift-default-5cb78544d9 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c8eef3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c8eef3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

openshift-ingress

deployment-controller

e2e-shared-b-w2-b00d69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b00d69-openshift-default-6556c878f5 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b00d69-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

Started

Container started

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

ProbeError

Startup probe error: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

Unhealthy

Startup probe failed: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

ProbeError

Startup probe error: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

Unhealthy

Startup probe failed: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ac422f: serviceaccount "payload-processing-e2e-praxis-a-ac422f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ac422f-d8899f48d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ac422f-d8899f48d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ac422f: serviceaccount "payload-processing-e2e-praxis-a-ac422f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ac422f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ac422f-d8899f48d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ac422f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ac422f-d8899f48d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

Created

Container created

opendatahub

kubelet

test-curl-7322-eef857

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7322-eef857

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7322-eef857

Started

Container started

opendatahub

kubelet

test-curl-7322-eef857

Created

Container created

opendatahub

kubelet

test-curl-7322-eef857

Killing

Stopping container test-curl-7322-eef857

opendatahub

multus

test-curl-7322-0bf4a7

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7322-0bf4a7

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7322-0bf4a7

Created

Container created

opendatahub

kubelet

test-curl-7322-0bf4a7

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Unhealthy

Readiness probe failed: Get "https://10.133.0.30:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x11)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-m2fn9

Unhealthy

Readiness probe failed: Get "http://10.132.0.26:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-praxis-b-293234-openshift-default-7c756b857

SuccessfulCreate

Created pod: e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-293234

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-293234

openshift-ingress

deployment-controller

e2e-praxis-b-293234-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-293234-openshift-default-7c756b857 from 0 to 1
(x9)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7322-0bf4a7

Killing

Stopping container test-curl-7322-0bf4a7
(x2)

llm

kubelet

echo-simulator-kserve-64b6f8f96c-7mmmn

Unhealthy

Readiness probe failed: Get "https://10.133.0.32:8000/ready": context deadline exceeded

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-qhvxv

Unhealthy

Readiness probe failed: Get "https://10.133.0.30:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zz7vx

Unhealthy

Readiness probe failed: Get "https://10.133.0.31:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-b00d69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b00d69-openshift-default-6556c878f5 from 6 to 8

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

openshift-ingress

multus

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5

SuccessfulCreate

Created pod: e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-b00d69-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ac422f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ac422f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ac632e-75c75cf4cb-nvwzm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ac632e-7d5967f8dc-blb7b

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-b-w3-c8eef3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff

SuccessfulCreate

Created pod: e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-c8eef3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

ProbeError

Startup probe error: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

Unhealthy

Startup probe failed: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

ProbeError

Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

Unhealthy

Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-293234-75cd6bf784

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf

SuccessfulCreate

Created pod: e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-e77b1d-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w3-e77b1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf from 2 to 3
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-293234-75cd6bf784

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-293234-75cd6bf784-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-293234: serviceaccount "payload-processing-e2e-praxis-b-293234" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-293234

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-293234-b68cdd699 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-293234-b68cdd699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-293234

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-293234-75cd6bf784 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-293234-b68cdd699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-293234-b68cdd699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-293234: serviceaccount "payload-processing-e2e-praxis-b-293234" not found
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

ProbeError

Startup probe error: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

Unhealthy

Startup probe failed: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w2-a2a10a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c from 3 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a2a10a-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c

SuccessfulCreate

Created pod: e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c

SuccessfulCreate

Created pod: e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

ProbeError

Startup probe error: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

Unhealthy

Startup probe failed: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

Unhealthy

Startup probe failed: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

ProbeError

Startup probe error: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-rp85v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-ac632e-openshift-default-c98c999-hhlpq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ac422f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ac422f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a2a10a-c7c86844-xd2qw

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.189:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a2a10a-5f7758695-k2fz7

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.188:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-5cb3d5-c86c6bb98-lb6hc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-5cb3d5-558fb66579-zq2b6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-autores-58d08b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-58d08b-openshift-default-7b46bbfbd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-58d08b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-58d08b

openshift-ingress

multus

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-58d08b-openshift-default-7b46bbfbd9

SuccessfulCreate

Created pod: e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

openshift-ingress

deployment-controller

payload-processing-e2e-autores-58d08b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-58d08b-c58b968db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-58d08b-866bd6bfff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-58d08b-866bd6bfff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-58d08b: serviceaccount "payload-processing-e2e-autores-58d08b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-58d08b-c58b968db

SuccessfulCreate

Created pod: payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-58d08b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-58d08b-866bd6bfff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-58d08b-866bd6bfff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-58d08b-c58b968db

FailedCreate

Error creating: pods "payload-processing-e2e-autores-58d08b-c58b968db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-58d08b: serviceaccount "payload-processing-e2e-autores-58d08b" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc

Created

Container created

openshift-ingress

replicaset-controller

e2e-explicit-a1a31f-openshift-default-69dd547b5

SuccessfulCreate

Created pod: e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

openshift-ingress

gateway_labeler_controller

e2e-explicit-a1a31f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-a1a31f

openshift-ingress

kubelet

payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

Created

Container created

openshift-ingress

deployment-controller

e2e-explicit-a1a31f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-a1a31f-openshift-default-69dd547b5 from 0 to 1

openshift-ingress

multus

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-5rhfk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-25ks8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-28nm4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-485pv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a2a10a-openshift-default-5d66c5686c-spd6m

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-a1a31f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-a1a31f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-a1a31f-5858ff7c48 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a1a31f-5858ff7c48

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-a1a31f-5858ff7c48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a1a31f: serviceaccount "payload-processing-e2e-explicit-a1a31f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a1a31f-5858ff7c48

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a1a31f: serviceaccount "payload-processing-e2e-explicit-a1a31f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-z2svs

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z2svs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-z2svs

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z2svs

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z2svs

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z2svs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b00d69-5b6cd74cb4-fs4rf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b00d69-548865f679-gt8mc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z2svs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-8lr9p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-5cb3d5-openshift-default-d8bc49c97-nlwh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-jzmrf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-s7wm6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-kfj87

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cjwxf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-cxmbv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nr4vd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-7tss6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b00d69-openshift-default-6556c878f5-nc5xf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-57ee15-7d67c54c5f-srwsp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-57ee15-7558957ff4-642nt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l

Killing

Stopping container payload-pre-processing
(x135)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jf2vf

Unhealthy

Readiness probe failed: Get "https://10.133.0.33:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

ProbeError

Readiness probe error: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

Unhealthy

Readiness probe failed: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

ProbeError

Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

Unhealthy

Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Unhealthy

Readiness probe failed: Get "http://10.134.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

ProbeError

Readiness probe error: Get "http://10.134.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-m2fn9

Unhealthy

Liveness probe failed: Get "http://10.132.0.26:6080/livez": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

Unhealthy

Readiness probe failed: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

Unhealthy

Readiness probe failed: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

ProbeError

Readiness probe error: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

ProbeError

Readiness probe error: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-6e8fca-7df8c6d488-xwlc2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-6e8fca-79548bc54c-5nw4l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

ProbeError

Readiness probe error: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

Unhealthy

Readiness probe failed: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-a1a31f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-a1a31f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-a1a31f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-a1a31f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1a31f-6dcdff67b7-gl4jg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1a31f-5858ff7c48-xz2tp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-2xtvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-c9p6x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-rd7m7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-lxxdp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-k9g26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-r5mjp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-6bvtx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-58d08b-c58b968db-9f7zq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.213:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-vqk6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-fs8qk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-58d08b-866bd6bfff-8vjgc

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.212:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-57ee15-openshift-default-b4df69477-xkxh2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-z5gbj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-k8v7v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-57h5r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-72gb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-6xp98

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-kk9nj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

ProbeError

Readiness probe error: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-hc6lc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-4dj8j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-8vfkv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-6e8fca-openshift-default-77759666dc-klmcf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

Unhealthy

Readiness probe failed: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-293234-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-293234-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-58d08b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-58d08b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-a1a31f-openshift-default-69dd547b5-rzdck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-58d08b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-58d08b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e77b1d-55ddb87958-l9wgq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e77b1d-9fdccb855-cfxfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-58d08b-openshift-default-7b46bbfbd9-2lhmf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-50e9fc-56cdb5789f-h86nr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-50e9fc-647b8c7b4-78rvk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-vbvh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-4c8b7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-e77b1d-openshift-default-c95557bdf-6k5jw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-50e9fc-openshift-default-cb4d69df5-5g5np

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c8eef3-6d879b4f7f-vdtzp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c8eef3-59f868587b-vc6dc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-3b8bf3-644c5dcf95-qpfcw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-3b8bf3-6d99f66f54-cv67j

Killing

Stopping container payload-processing
(x10)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-qj7mt

Killing

Stopping container istio-proxy
(x11)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-c8eef3-openshift-default-64dd957bff-jdkkd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-gcqm8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-shared-b-w4-3b8bf3-openshift-default-dockercfg-256pt); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w4-3b8bf3-openshift-default-69884564c7-mqfhx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ac422f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-ac422f-openshift-default-5cb78544d9

SuccessfulCreate

Created pod: e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

Created

Container created

openshift-ingress

multus

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-ac422f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ac422f-openshift-default-5cb78544d9 from 1 to 2

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-3cc458-99565d668-p2qbm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-3cc458-779ff4f8cf-lt8qr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-419d32-6dff5c9996-jcbjp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-419d32-6b9bb548f9-bzxk2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-4h9sn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-msq9x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-lllmz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-vpvrg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-hlsvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-r4g7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-7dtrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-mtv5v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-2n6sc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-3cc458-openshift-default-75dc4c6579-29584

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-wdhjw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-khp9f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-gv6s8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-lctr9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-mgrkw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-pmxjm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-68cqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-2t8xs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-m4txv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-419d32-openshift-default-6d8ff84c79-4cvwc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-praxis-a-ac422f-openshift-default-5cb78544d9

SuccessfulCreate

Created pod: e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-a-ac422f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ac422f-openshift-default-5cb78544d9 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ac422f-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ac422f-77b7cd85cf-dgqtw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ac422f-d8899f48d-kmn6r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-npnpr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-nwtxs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ac422f-openshift-default-5cb78544d9-5gcv6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-293234-75cd6bf784-f78v8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-293234-b68cdd699-dcj4f

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-z2svs

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-z2svs

openshift-ingress

kubelet

e2e-praxis-b-293234-openshift-default-7c756b857-hnkbv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-366d9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-366d9f

openshift-ingress

replicaset-controller

e2e-noten-366d9f-openshift-default-5f56b7785c

SuccessfulCreate

Created pod: e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

openshift-ingress

deployment-controller

e2e-noten-366d9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-366d9f-openshift-default-5f56b7785c from 0 to 1

openshift-ingress

kubelet

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

Created

Container created

openshift-ingress

multus

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-366d9f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-366d9f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-366d9f-openshift-default-5f56b7785c-hk2g5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-47vdr

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-47vdr

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-b424a5-b698d4bb8-vvqmn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-b424a5-7d97cc8c87-vvjcw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-zdd4r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5z9pd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-d46wk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-chlbj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v9skr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-5th7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-9sdtp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-v5nqx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-kw5bx

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-b424a5-openshift-default-6466f75c99-jhjq5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-cxsgh

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-67bf986f99 from 3 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-cxsgh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-9mddx

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mddx

Killing

Stopping container discovery

openshift-ingress

kubelet

maas-default-gateway-openshift-default-67bf986f99-wjstn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-67bf986f99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-67bf986f99-wjstn

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-67bf986f99 from 2 to 1