Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn to ip-10-0-143-53.us-west-1.compute.internal

kuadrant-system

authorino-647848b5d-9r5cm

Scheduled

Successfully assigned kuadrant-system/authorino-647848b5d-9r5cm to ip-10-0-143-53.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-8ldm6

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-8ldm6 to ip-10-0-143-53.us-west-1.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-nmcf6

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-nmcf6 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg to ip-10-0-141-63.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-t4n2d

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-t4n2d to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-qq4mp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qq4mp to ip-10-0-143-53.us-west-1.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-5rmm4

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-5rmm4 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-7v26z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7v26z to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2 to ip-10-0-143-53.us-west-1.compute.internal

opendatahub

maas-controller-57c568df98-jc6t5

Scheduled

Successfully assigned opendatahub/maas-controller-57c568df98-jc6t5 to ip-10-0-137-148.us-west-1.compute.internal

opendatahub

maas-controller-5f54bdd8cd-ncrz5

Scheduled

Successfully assigned opendatahub/maas-controller-5f54bdd8cd-ncrz5 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5 to ip-10-0-143-53.us-west-1.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-wtds2

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-wtds2 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv to ip-10-0-137-148.us-west-1.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-2tmfd

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-2tmfd to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-cpsx2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-cpsx2 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp to ip-10-0-137-148.us-west-1.compute.internal

kuadrant-system

authorino-56c6c9ddd5-cp9zx

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-cp9zx to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-6bnvm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-6bnvm to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-4znwv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4znwv to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-gltnm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gltnm to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-j6ldv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-j6ldv to ip-10-0-137-148.us-west-1.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-txds2

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-txds2 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-4kf6r

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4kf6r to ip-10-0-137-148.us-west-1.compute.internal

kuadrant-system

authorino-5f4bb8f767-9xcl4

Scheduled

Successfully assigned kuadrant-system/authorino-5f4bb8f767-9xcl4 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-5cb564c48d-j7qlx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cb564c48d-j7qlx to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-5cb564c48d-fslfx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cb564c48d-fslfx to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn to ip-10-0-141-63.us-west-1.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-djnzm

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-djnzm to ip-10-0-141-63.us-west-1.compute.internal

kuadrant-system

authorino-6b49fc69d8-xgzhv

Scheduled

Successfully assigned kuadrant-system/authorino-6b49fc69d8-xgzhv to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-kf9dc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-kf9dc to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b to ip-10-0-137-148.us-west-1.compute.internal

kuadrant-system

authorino-6f6944bcdd-khgsd

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-khgsd to ip-10-0-143-53.us-west-1.compute.internal

opendatahub

ai-gateway-controller-654879bb7c-lhq6m

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-654879bb7c-lhq6m to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-752be8-openshift-default-79688d7695-mvqqp to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-psjjr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-psjjr to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-qn4q8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-qn4q8 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7 to ip-10-0-137-148.us-west-1.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-b5nfc

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-b5nfc to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-7ljch

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ljch to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-db92l to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np to ip-10-0-141-63.us-west-1.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-zsk4m

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-zsk4m to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn to ip-10-0-141-63.us-west-1.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-dnvj9

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-dnvj9 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898 to ip-10-0-137-148.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-zbvhk

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-zbvhk to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-c574b7b6f-b5mx6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-c574b7b6f-b5mx6 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5 to ip-10-0-141-63.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-csnwf

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-csnwf to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx to ip-10-0-141-63.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-7cd8774477-vdcld

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7cd8774477-vdcld to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg to ip-10-0-137-148.us-west-1.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-gc9gd

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-gc9gd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v to ip-10-0-137-148.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-7bcdc9f9cc-wnf8n

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7bcdc9f9cc-wnf8n to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4 to ip-10-0-141-63.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8646f9bf7f-vj88j to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw to ip-10-0-143-53.us-west-1.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-d2fw9

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-d2fw9 to ip-10-0-143-53.us-west-1.compute.internal

cert-manager

cert-manager-597b95cb84-rbh5p

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-rbh5p to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk to ip-10-0-143-53.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-7bcdc9f9cc-bkxqq

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7bcdc9f9cc-bkxqq to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh to ip-10-0-143-53.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8646f9bf7f-r572b to ip-10-0-141-63.us-west-1.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-hlvcx

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-hlvcx to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts to ip-10-0-137-148.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-66fb6cc5c5-f2b6q

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-66fb6cc5c5-f2b6q to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g to ip-10-0-137-148.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8646f9bf7f-lj2c4 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb to ip-10-0-137-148.us-west-1.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-svrwj

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-svrwj to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-r842r

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-r842r to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lvhqt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lvhqt to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj to ip-10-0-141-63.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-657c7b7984-zkcf6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-657c7b7984-zkcf6 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn to ip-10-0-137-148.us-west-1.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58c6585447-thkzr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58c6585447-thkzr to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-f7c92a85-67769656df-q75qn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f7c92a85-67769656df-q75qn to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd to ip-10-0-141-63.us-west-1.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-6rd7f

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-6rd7f to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l to ip-10-0-137-148.us-west-1.compute.internal

kuadrant-system

authorino-57f7f8659f-4b2zg

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-4b2zg to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb to ip-10-0-137-148.us-west-1.compute.internal

opendatahub

test-curl-7504-d00901

Scheduled

Successfully assigned opendatahub/test-curl-7504-d00901 to ip-10-0-141-63.us-west-1.compute.internal

opendatahub

test-curl-7504-7e2255

Scheduled

Successfully assigned opendatahub/test-curl-7504-7e2255 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl to ip-10-0-137-148.us-west-1.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-5qn4x

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-5qn4x to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-w99g7

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-w99g7 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b to ip-10-0-137-148.us-west-1.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-d2vp6

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-d2vp6 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t to ip-10-0-141-63.us-west-1.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt to ip-10-0-143-53.us-west-1.compute.internal

opendatahub

test-curl-7504-5eab08

Scheduled

Successfully assigned opendatahub/test-curl-7504-5eab08 to ip-10-0-141-63.us-west-1.compute.internal

opendatahub

test-curl-7501-188b00

Scheduled

Successfully assigned opendatahub/test-curl-7501-188b00 to ip-10-0-141-63.us-west-1.compute.internal

opendatahub

test-curl-7501-08240e

Scheduled

Successfully assigned opendatahub/test-curl-7501-08240e to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs to ip-10-0-137-148.us-west-1.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-qf644

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-qf644 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692 to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

router-default-94bcddf7f-vbt59

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-94bcddf7f-vbt59

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-94bcddf7f-vbt59

Scheduled

Successfully assigned openshift-ingress/router-default-94bcddf7f-vbt59 to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp to ip-10-0-137-148.us-west-1.compute.internal

opendatahub

model-serving-api-75bd89fdfc-jgwjj

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-jgwjj to ip-10-0-141-63.us-west-1.compute.internal

opendatahub

odh-model-controller-769875db56-5s5vk

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-5s5vk to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-868b06-openshift-default-58984b7645-274sp to ip-10-0-143-53.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-15eab294-6db845f85-gzp49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-15eab294-6db845f85-gzp49 to ip-10-0-141-63.us-west-1.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9 to ip-10-0-141-63.us-west-1.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk to ip-10-0-141-63.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf to ip-10-0-143-53.us-west-1.compute.internal

openshift-jobset-operator

jobset-controller-manager-7b9d45fccb-s2gpm

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-7b9d45fccb-s2gpm to ip-10-0-141-63.us-west-1.compute.internal

opendatahub

test-curl-7498-13087b

Scheduled

Successfully assigned opendatahub/test-curl-7498-13087b to ip-10-0-137-148.us-west-1.compute.internal

opendatahub

test-curl-7498-e26187

Scheduled

Successfully assigned opendatahub/test-curl-7498-e26187 to ip-10-0-143-53.us-west-1.compute.internal

opendatahub

test-curl-7498-2ac3b3

Scheduled

Successfully assigned opendatahub/test-curl-7498-2ac3b3 to ip-10-0-137-148.us-west-1.compute.internal

opendatahub

test-curl-7498-655f87

Scheduled

Successfully assigned opendatahub/test-curl-7498-655f87 to ip-10-0-137-148.us-west-1.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-94bcddf7f from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-94bcddf7f

SuccessfulCreate

Created pod: router-default-94bcddf7f-vbt59
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-94bcddf7f-vbt59

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-94bcddf7f-vbt59

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-94bcddf7f-vbt59

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-94bcddf7f-vbt59

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-94bcddf7f-vbt59

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-94bcddf7f-vbt59

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-94bcddf7f-vbt59

Started

Container started

openshift-ingress

kubelet

router-default-94bcddf7f-vbt59

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-psjjr

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-psjjr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-psjjr

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-psjjr

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-psjjr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.904s (3.904s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-psjjr

Created

Container created
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-psjjr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-psjjr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-bc8769f9

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58c6585447 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-thkzr

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-bc8769f9 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-thkzr

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk

Created

Container created

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-bc8769f9-9wkgk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.023s (4.023s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.614s (11.615s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-8646f9bf7f from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8646f9bf7f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8646f9bf7f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8646f9bf7f-vj88j

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8646f9bf7f

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8646f9bf7f-r572b

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8646f9bf7f-r572b

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.528s (3.528s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.343s (3.343s including waiting). Image size: 273709574 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.252s (3.252s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 819ms (820ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-vj88j

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 810ms (810ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 836ms (836ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-lj2c4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-tvqh2

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

opendatahub-operator-controller-manager-8646f9bf7f-vj88j_db7dcac8-fda5-420d-abb9-2d48cb4554bb

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-8646f9bf7f-vj88j_db7dcac8-fda5-420d-abb9-2d48cb4554bb became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8646f9bf7f-r572b

Started

Container started
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-2tmfd

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-djnzm

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-2tmfd

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-5rmm4

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-djnzm

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-djnzm

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2tmfd

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5rmm4

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-5rmm4

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-djnzm

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.927s (2.927s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-djnzm

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-djnzm

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-djnzm_41836c98-e4c7-4ce4-ac64-7ab0a79259c2 became leader

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2tmfd

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.081s (5.081s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5rmm4

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5rmm4

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-5rmm4

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.314s (4.314s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2tmfd

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2tmfd

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-rbh5p

cert-manager

multus

cert-manager-597b95cb84-rbh5p

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-rbh5p

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-csnwf

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-csnwf

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-csnwf

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

cert-manager

kubelet

cert-manager-597b95cb84-rbh5p

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.176s (4.176s including waiting). Image size: 309650901 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-b5nfc

cert-manager

kubelet

cert-manager-597b95cb84-rbh5p

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-rbh5p

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b5nfc

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-b5nfc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-hlvcx

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-hlvcx

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-hlvcx

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b5nfc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.106s (3.106s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-csnwf

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-csnwf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.702s (5.702s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b5nfc

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-b5nfc

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-csnwf

Started

Container started

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-csnwf_3128aa09-b341-4261-adba-b6cb4c974b44

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-csnwf_3128aa09-b341-4261-adba-b6cb4c974b44 became leader

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-zsk4m

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

kuadrant-system

authorino-operator-7b7bb4bc77-b5nfc_94e22283-8047-4ce5-a7b7-498ef0f0cd68

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-b5nfc_94e22283-8047-4ce5-a7b7-498ef0f0cd68 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-zsk4m

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-5cb564c48d

SuccessfulCreate

Created pod: kube-auth-proxy-5cb564c48d-j7qlx

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5cb564c48d from 0 to 2

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zsk4m

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-hlvcx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 3.584s (3.584s including waiting). Image size: 177967631 bytes.

openshift-ingress

replicaset-controller

kube-auth-proxy-5cb564c48d

SuccessfulCreate

Created pod: kube-auth-proxy-5cb564c48d-fslfx

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-hlvcx

Started

Container started

openshift-ingress

multus

kube-auth-proxy-5cb564c48d-fslfx

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

kuadrant-system

limitador-operator-controller-manager-5778bb4449-hlvcx_d4090dd8-5a54-4d41-be97-833d95a49c83

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-hlvcx_d4090dd8-5a54-4d41-be97-833d95a49c83 became leader

openshift-ingress

multus

kube-auth-proxy-5cb564c48d-j7qlx

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-j7qlx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-fslfx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-c574b7b6f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-c574b7b6f-b5mx6

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-hlvcx

Created

Container created

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-c574b7b6f from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c574b7b6f-b5mx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c574b7b6f-b5mx6

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c574b7b6f-b5mx6

Created

Container created

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-c574b7b6f-b5mx6

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zsk4m

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zsk4m

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.757s (2.757s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-zsk4m

Started

Container started

kuadrant-system

dns-operator-controller-manager-8557cbdb84-zsk4m_380c971f-a7b9-44dc-991a-10eaf62068b7

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-zsk4m_380c971f-a7b9-44dc-991a-10eaf62068b7 became leader

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-fslfx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.124s (3.124s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-j7qlx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.153s (3.153s including waiting). Image size: 188904677 bytes.

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-gc9gd

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-fslfx

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-fslfx

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-j7qlx

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5cb564c48d-j7qlx

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-gc9gd

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-gc9gd

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-4b2zg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-4b2zg

kuadrant-system

multus

authorino-57f7f8659f-4b2zg

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-gc9gd

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-gc9gd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.937s (1.937s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-gc9gd

Started

Container started

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-cp9zx

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

multus

limitador-limitador-7c9b87d574-d2fw9

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dnvj9

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d2fw9

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

authorino-56c6c9ddd5-cp9zx

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-zbvhk

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp9zx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-dnvj9

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-d2fw9

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-dnvj9

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-zbvhk

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-4b2zg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.172s (3.172s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-zbvhk

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

kubelet

authorino-57f7f8659f-4b2zg

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-4b2zg

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d2fw9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.987s (1.987s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d2fw9

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d2fw9

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp9zx

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp9zx

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-4b2zg

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-4b2zg

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp9zx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.547s (3.547s including waiting). Image size: 204096810 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-zbvhk

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dnvj9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.86s (5.86s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-zbvhk

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-zbvhk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.785s (4.785s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dnvj9

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-dnvj9

Created

Container created

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-sc55c"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-7q9nk"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-7b9d45fccb from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-7b9d45fccb

SuccessfulCreate

Created pod: jobset-controller-manager-7b9d45fccb-s2gpm

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

multus

jobset-controller-manager-7b9d45fccb-s2gpm

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-7b9d45fccb-s2gpm

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-gc9gd

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-gc9gd

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

openshift-jobset-operator

kubelet

jobset-controller-manager-7b9d45fccb-s2gpm

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.408s (4.408s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-7b9d45fccb-s2gpm

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-7b9d45fccb-s2gpm

Started

Container started

openshift-jobset-operator

jobset-controller-manager-7b9d45fccb-s2gpm_bcc3eaca-3bf1-41ad-ae64-153e7c7b5d37

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-7b9d45fccb-s2gpm_bcc3eaca-3bf1-41ad-ae64-153e7c7b5d37 became leader

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-nmcf6

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-csnwf

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-csnwf

Killing

Stopping container manager

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-nmcf6

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nmcf6

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nmcf6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.005s (2.005s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nmcf6

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-nmcf6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-zbvhk_948db701-1278-4fac-bcab-ce4acdaefeaf

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-zbvhk_948db701-1278-4fac-bcab-ce4acdaefeaf became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-nmcf6_084bce03-135b-40f3-b5ab-f596bee29602

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-nmcf6_084bce03-135b-40f3-b5ab-f596bee29602 became leader

opendatahub

replicaset-controller

maas-controller-57c568df98

SuccessfulCreate

Created pod: maas-controller-57c568df98-jc6t5

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-57c568df98 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5f54bdd8cd from 0 to 1

opendatahub

kubelet

maas-controller-57c568df98-jc6t5

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:e2abc5e183cf5379dd0b306c36b28792c5faf298bdbd39f48b9ad9bd3a2f4804"

opendatahub

replicaset-controller

maas-controller-5f54bdd8cd

SuccessfulCreate

Created pod: maas-controller-5f54bdd8cd-ncrz5

opendatahub

multus

maas-controller-57c568df98-jc6t5

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

opendatahub

multus

maas-controller-5f54bdd8cd-ncrz5

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-57c568df98-jc6t5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e2abc5e183cf5379dd0b306c36b28792c5faf298bdbd39f48b9ad9bd3a2f4804" in 12.023s (12.023s including waiting). Image size: 200069637 bytes.

opendatahub

kubelet

maas-controller-57c568df98-jc6t5

Created

Container created

opendatahub

kubelet

maas-controller-57c568df98-jc6t5

Started

Container started

opendatahub

kubelet

maas-controller-5f54bdd8cd-ncrz5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e2abc5e183cf5379dd0b306c36b28792c5faf298bdbd39f48b9ad9bd3a2f4804" in 11.493s (11.493s including waiting). Image size: 200069637 bytes.

opendatahub

maas-controller-57c568df98-jc6t5_eec3c284-571f-40f3-ab5b-0711f823ea66

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-57c568df98-jc6t5_eec3c284-571f-40f3-ab5b-0711f823ea66 became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-svrwj

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-svrwj

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-svrwj

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-svrwj

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

replicaset-controller

maas-controller-57c568df98

SuccessfulDelete

Deleted pod: maas-controller-57c568df98-jc6t5

opendatahub

kubelet

maas-controller-57c568df98-jc6t5

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-57c568df98 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-svrwj

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 13.191s (13.191s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-svrwj

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-svrwj

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-r842r

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r842r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-r842r

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r842r

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r842r

Created

Container created
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r842r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-r842r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-psjjr

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-wtds2

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-psjjr

Killing

Stopping container discovery

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-t4n2d

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-5s5vk

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-jgwjj

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

maas-controller-5f54bdd8cd-ncrz5_b2df362f-e551-46df-831c-186dc177bb9c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5f54bdd8cd-ncrz5_b2df362f-e551-46df-831c-186dc177bb9c became leader

opendatahub

kubelet

model-serving-api-75bd89fdfc-jgwjj

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t4n2d

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

odh-model-controller-769875db56-5s5vk

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

model-serving-api-75bd89fdfc-jgwjj

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-t4n2d

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-wtds2

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

odh-model-controller-769875db56-5s5vk

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-wtds2

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-jgwjj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.057s (2.057s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-jgwjj

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-jgwjj

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t4n2d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.803s (2.803s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-5s5vk

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t4n2d

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-wtds2

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.63s (2.63s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-wtds2

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-wtds2

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t4n2d

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-5s5vk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.103s (3.103s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-5s5vk

Created

Container created

opendatahub

kserve-controller-manager-776cc66d47-wtds2_2822d5c1-50e2-4349-aee6-9ee73dc943ff

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-wtds2_2822d5c1-50e2-4349-aee6-9ee73dc943ff became leader

opendatahub

odh-model-controller-769875db56-5s5vk_cc7d8860-d47a-4e08-9038-42339b992ea0

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-5s5vk_cc7d8860-d47a-4e08-9038-42339b992ea0 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-t4n2d_e183125f-b9bb-423c-94f6-e63de9b832bd

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-t4n2d_e183125f-b9bb-423c-94f6-e63de9b832bd became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-khgsd
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-647848b5d from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-khgsd

kuadrant-system

replicaset-controller

authorino-647848b5d

SuccessfulDelete

Deleted pod: authorino-647848b5d-9r5cm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

authorino-647848b5d

SuccessfulCreate

Created pod: authorino-647848b5d-9r5cm

kuadrant-system

kubelet

authorino-6f6944bcdd-khgsd

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-647848b5d from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6b49fc69d8 from 0 to 1

kuadrant-system

multus

authorino-6f6944bcdd-khgsd

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-6b49fc69d8

SuccessfulCreate

Created pod: authorino-6b49fc69d8-xgzhv
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Created

Container created

kuadrant-system

multus

authorino-6b49fc69d8-xgzhv

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-647848b5d-9r5cm

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6b49fc69d8-xgzhv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Started

Container started

kuadrant-system

multus

authorino-647848b5d-9r5cm

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f6944bcdd-khgsd

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-khgsd

Created

Container created

kuadrant-system

kubelet

authorino-647848b5d-9r5cm

Created

Container created

kuadrant-system

kubelet

authorino-647848b5d-9r5cm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.491s (1.491s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-647848b5d-9r5cm

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-khgsd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.885s (1.885s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp9zx

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-647848b5d-9r5cm

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6b49fc69d8-xgzhv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.498s (1.498s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6b49fc69d8-xgzhv

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-khgsd

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-cp9zx

kuadrant-system

kubelet

authorino-6b49fc69d8-xgzhv

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8ldm6

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-8ldm6

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-8ldm6

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8ldm6

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8ldm6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 764ms (764ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-8ldm6

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-t4n2d

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-t4n2d

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-txds2

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "ai-gateway-controller-metrics-tls" not found

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-txds2

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1
(x2)

opendatahub

kubelet

maas-controller-5f54bdd8cd-ncrz5

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:e2abc5e183cf5379dd0b306c36b28792c5faf298bdbd39f48b9ad9bd3a2f4804"

opendatahub

multus

ai-gateway-controller-7d85675f98-txds2

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-txds2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

maas-controller-5f54bdd8cd-ncrz5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:e2abc5e183cf5379dd0b306c36b28792c5faf298bdbd39f48b9ad9bd3a2f4804" in 904ms (904ms including waiting). Image size: 200069637 bytes.
(x2)

opendatahub

kubelet

maas-controller-5f54bdd8cd-ncrz5

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5f54bdd8cd-ncrz5

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-txds2

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-txds2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.903s (1.903s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-txds2

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-txds2_b2b73e9b-3e52-415c-b6f7-cb8211d02bdc

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-txds2_b2b73e9b-3e52-415c-b6f7-cb8211d02bdc became leader
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-w99g7

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-qn4q8

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qn4q8

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-w99g7

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-qn4q8

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-w99g7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qn4q8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.721s (2.721s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qn4q8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-qn4q8

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-w99g7

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-w99g7

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-w99g7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.767s (2.767s including waiting). Image size: 125353965 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-654879bb7c

SuccessfulCreate

Created pod: ai-gateway-controller-654879bb7c-lhq6m

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-654879bb7c from 0 to 1

opendatahub

llmisvc-controller-manager-6466c554d8-8ldm6_4a2678da-fe2a-4503-98c8-67e83116825d

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-8ldm6_4a2678da-fe2a-4503-98c8-67e83116825d became leader

opendatahub

multus

ai-gateway-controller-654879bb7c-lhq6m

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-654879bb7c-lhq6m

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-654879bb7c-lhq6m

Started

Container started

opendatahub

kubelet

ai-gateway-controller-654879bb7c-lhq6m

Created

Container created

opendatahub

kubelet

ai-gateway-controller-654879bb7c-lhq6m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 871ms (871ms including waiting). Image size: 183979433 bytes.

opendatahub

maas-controller-5f54bdd8cd-ncrz5_4eee9ca2-ee52-42e3-9c3d-8baba0e5696d

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5f54bdd8cd-ncrz5_4eee9ca2-ee52-42e3-9c3d-8baba0e5696d became leader

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-txds2

opendatahub

kubelet

ai-gateway-controller-7d85675f98-txds2

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-ljs8d

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.885s (1.885s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-6rd7f

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6rd7f

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-6rd7f

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6rd7f

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6rd7f

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.839s (1.839s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6rd7f

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

opendatahub

ai-gateway-controller-654879bb7c-lhq6m_7a8dab4d-4fbf-4a1c-8ba1-9e888f8e09c7

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-654879bb7c-lhq6m_7a8dab4d-4fbf-4a1c-8ba1-9e888f8e09c7 became leader

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-5qn4x

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-5qn4x

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-5qn4x

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-5qn4x

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 664ms (664ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-5qn4x

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-5qn4x

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-d2vp6

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-d2vp6

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-d2vp6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-d2vp6

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-d2vp6

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-d2vp6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 620ms (620ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 594ms (594ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8w9gck

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qf644

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-qf644

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

multus

echo-simulator-kserve-64b6f8f96c-qf644

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qf644

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.351s (2.351s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qf644

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qf644

Started

Container started

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-7w5wv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 565ms (565ms including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 580ms (580ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58c6585447 from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-7v26z

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-7ljch

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-kf9dc

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7v26z

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7v26z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7v26z

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-kf9dc

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-kf9dc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-kf9dc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-kf9dc

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-7v26z

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7ljch

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-7ljch

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7ljch

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.844s (3.844s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7ljch

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7ljch

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7v26z

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7v26z

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-kf9dc

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-kf9dc

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

kuadrant-system

replicaset-controller

authorino-5f4bb8f767

SuccessfulCreate

Created pod: authorino-5f4bb8f767-9xcl4

kuadrant-system

multus

authorino-5f4bb8f767-9xcl4

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5f4bb8f767-9xcl4

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5f4bb8f767-9xcl4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.609s (1.609s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5f4bb8f767-9xcl4

Created

Container created

kuadrant-system

kubelet

authorino-5f4bb8f767-9xcl4

Started

Container started

kuadrant-system

replicaset-controller

authorino-6b49fc69d8

SuccessfulDelete

Deleted pod: authorino-6b49fc69d8-xgzhv
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7ljch

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7ljch

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

kuadrant-system

kubelet

authorino-6b49fc69d8-xgzhv

Killing

Stopping container authorino
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-6b49fc69d8 from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58c6585447 from 4 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-4kf6r

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4kf6r

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4kf6r

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-4kf6r

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4kf6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4kf6r

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4kf6r

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-15eab294

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-15eab294

openshift-ingress

gateway_labeler_controller

e2e-migrate-4b78c516-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4b78c516-gw

openshift-ingress

gateway_labeler_controller

e2e-ait-0e1bbe4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0e1bbe4b

openshift-ingress

deployment-controller

e2e-ait-15eab294-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-15eab294-openshift-default-649cdc68c5 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-0e1bbe4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0e1bbe4b-openshift-default-f46944f8c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0e1bbe4b-openshift-default-f46944f8c

SuccessfulCreate

Created pod: e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

openshift-ingress

multus

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-4b78c516-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c

SuccessfulCreate

Created pod: e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

openshift-ingress

replicaset-controller

e2e-ait-15eab294-openshift-default-649cdc68c5

SuccessfulCreate

Created pod: e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

openshift-ingress

multus

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-6ab60e97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6ab60e97

openshift-ingress

replicaset-controller

e2e-ait-6ab60e97-openshift-default-9d9dcc997

SuccessfulCreate

Created pod: e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

openshift-ingress

deployment-controller

e2e-ait-6ab60e97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6ab60e97-openshift-default-9d9dcc997 from 0 to 1

openshift-ingress

multus

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4b78c516

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4b78c516-67786978cc

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4b78c516-67786978cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4b78c516: serviceaccount "payload-processing-e2e-migrate-4b78c516" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4b78c516: serviceaccount "payload-processing-e2e-migrate-4b78c516" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4b78c516

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4b78c516-67786978cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-b83a178e-openshift-default-8475f7654f

SuccessfulCreate

Created pod: e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

openshift-ingress

gateway_labeler_controller

e2e-derive-b83a178e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b83a178e

openshift-ingress

deployment-controller

e2e-derive-b83a178e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b83a178e-openshift-default-8475f7654f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t

openshift-ingress

multus

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4b78c516-67786978cc

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-15eab294

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-15eab294-5b4467ddbc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-15eab294-6db845f85

FailedCreate

Error creating: pods "payload-processing-e2e-ait-15eab294-6db845f85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-15eab294: serviceaccount "payload-processing-e2e-ait-15eab294" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-15eab294

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-15eab294-6db845f85 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-15eab294: serviceaccount "payload-processing-e2e-ait-15eab294" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

openshift-ingress

kubelet

payload-processing-e2e-ait-15eab294-6db845f85-gzp49

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-15eab294-6db845f85

SuccessfulCreate

Created pod: payload-processing-e2e-ait-15eab294-6db845f85-gzp49

openshift-ingress

multus

payload-processing-e2e-ait-15eab294-6db845f85-gzp49

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0e1bbe4b: serviceaccount "payload-processing-e2e-ait-0e1bbe4b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0e1bbe4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15eab294-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15eab294-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0e1bbe4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0e1bbe4b-84f54fc89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0e1bbe4b-84f54fc89

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0e1bbe4b-84f54fc89

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0e1bbe4b-84f54fc89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0e1bbe4b: serviceaccount "payload-processing-e2e-ait-0e1bbe4b" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-15eab294-6db845f85-gzp49

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.002s (3.002s including waiting). Image size: 125353965 bytes.

openshift-ingress

multus

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.149s (3.149s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-15eab294-6db845f85-gzp49

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-15eab294-6db845f85-gzp49

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6ab60e97: serviceaccount "payload-processing-e2e-ait-6ab60e97" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6ab60e97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6ab60e97-c6f6d7f6c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6ab60e97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6ab60e97-6695c98759 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6ab60e97-6695c98759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6ab60e97-6695c98759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6ab60e97: serviceaccount "payload-processing-e2e-ait-6ab60e97" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 814ms (814ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz

openshift-ingress

kubelet

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6ab60e97-6695c98759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh

openshift-ingress

multus

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.64s (2.64s including waiting). Image size: 125353965 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b83a178e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b83a178e-57bf8bbb77 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b83a178e-57bf8bbb77

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b83a178e-57bf8bbb77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b83a178e: serviceaccount "payload-processing-e2e-derive-b83a178e" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b83a178e: serviceaccount "payload-processing-e2e-derive-b83a178e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b83a178e-57bf8bbb77

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b83a178e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

Unhealthy

Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

ProbeError

Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e1bbe4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e1bbe4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-4b78c516-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-4b78c516-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:60550->10.133.0.59:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": read tcp 10.133.0.2:60550->10.133.0.59:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e1bbe4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0e1bbe4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-0e1bbe4b-84f54fc89-j9jrf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-4b78c516-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-4b78c516-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0e1bbe4b-5b6477dd99-wn5d7

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6ab60e97-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6ab60e97-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b78c516-777fcd7fff-wr46t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b78c516-67786978cc-ps68q

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b83a178e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b83a178e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-6ab60e97-c6f6d7f6c-pjrtz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6ab60e97-6695c98759-czvkh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-0e1bbe4b-openshift-default-f46944f8c-ncwd2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-0144bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-0144bd

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-4b78c516-gw-openshift-default-6dc7ccd9c-zmpzr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-6ab60e97-openshift-default-9d9dcc997-62bzl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-0144bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0144bd-openshift-default-67b9448dc from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 0 to 1

openshift-ingress

multus

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulCreate

Created pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-7abb95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-7abb95

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-10a7aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-10a7aa

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-7abb95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-7abb95-685445b999 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-7abb95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-7abb95-7d59cf95fc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-7abb95-685445b999

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-7abb95: serviceaccount "payload-processing-e2e-worker-w3-7abb95" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b83a178e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-7abb95-685445b999

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-7abb95-685445b999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-7abb95: serviceaccount "payload-processing-e2e-worker-w3-7abb95" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-b83a178e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-15eab294-6db845f85-gzp49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-15eab294-5b4467ddbc-j7c4d

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-0144bd-546dccbd5c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-0144bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15eab294-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-15eab294-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-0144bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-0144bd-546dccbd5c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-0144bd-546dccbd5c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-0144bd-546dccbd5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-0144bd: serviceaccount "payload-processing-e2e-worker-w4-0144bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-0144bd: serviceaccount "payload-processing-e2e-worker-w4-0144bd" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-b83a178e-57bf8bbb77-drbvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b83a178e-54cb59d6cf-zhxjl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-10a7aa: serviceaccount "payload-processing-e2e-worker-w0-10a7aa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-10a7aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-10a7aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-10a7aa: serviceaccount "payload-processing-e2e-worker-w0-10a7aa" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ait-15eab294-openshift-default-649cdc68c5

FailedCreate

Error creating: pods "e2e-ait-15eab294-openshift-default-649cdc68c5-" is forbidden: error looking up service account openshift-ingress/e2e-ait-15eab294-openshift-default: serviceaccount "e2e-ait-15eab294-openshift-default" not found

openshift-ingress

kubelet

e2e-ait-15eab294-openshift-default-649cdc68c5-gd8p9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-15eab294-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-15eab294-openshift-default-649cdc68c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-e1ca71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-e1ca71

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-b83a178e-openshift-default-8475f7654f-v6djx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-869cca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-869cca

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 0 to 1

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-e1ca71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-e1ca71-65c459b9dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-e1ca71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e1ca71: serviceaccount "payload-processing-e2e-worker-w2-e1ca71" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e1ca71: serviceaccount "payload-processing-e2e-worker-w2-e1ca71" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-869cca-687964869c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-869cca-687964869c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-869cca: serviceaccount "payload-processing-e2e-worker-w1-869cca" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-869cca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-869cca-687964869c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-869cca: serviceaccount "payload-processing-e2e-worker-w1-869cca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-869cca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-869cca-687964869c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

ProbeError

Readiness probe error: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

Unhealthy

Readiness probe failed: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 1 to 2

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58c6585447 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4kf6r

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-4kf6r

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7cd8774477 from 0 to 1
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-7cd8774477

FailedCreate

Error creating: pods "payload-processing-external-model-7cd8774477-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-7cd8774477

SuccessfulCreate

Created pod: payload-processing-external-model-7cd8774477-vdcld

models-as-a-service

kubelet

payload-processing-external-model-7cd8774477-vdcld

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7cd8774477-vdcld

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7cd8774477-vdcld

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7cd8774477-vdcld

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

Created

Container created

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58c6585447 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-qq4mp

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-6bnvm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-j6ldv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58c6585447-4znwv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-4znwv

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-6bnvm

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-qq4mp

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-j6ldv

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-66fb6cc5c5

SuccessfulCreate

Created pod: payload-processing-external-model-66fb6cc5c5-f2b6q

models-as-a-service

kubelet

payload-processing-external-model-66fb6cc5c5-f2b6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-66fb6cc5c5-f2b6q

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-66fb6cc5c5 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-66fb6cc5c5-f2b6q

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-66fb6cc5c5-f2b6q

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-58c6585447-cpsx2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58c6585447 from 8 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-gltnm

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 1 to 2

openshift-ingress

multus

maas-default-gateway-openshift-default-58c6585447-cpsx2

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x4)

models-as-a-service

kubelet

payload-processing-external-model-7cd8774477-vdcld

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-a2f1ffbe7a37" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-66fb6cc5c5

SuccessfulDelete

Deleted pod: payload-processing-external-model-66fb6cc5c5-f2b6q

models-as-a-service

kubelet

payload-processing-external-model-66fb6cc5c5-f2b6q

Killing

Stopping container payload-processing
(x7)

models-as-a-service

kubelet

payload-processing-external-model-66fb6cc5c5-f2b6q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-66fb6cc5c5 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-7bcdc9f9cc

SuccessfulCreate

Created pod: payload-processing-external-model-7bcdc9f9cc-wnf8n

models-as-a-service

multus

payload-processing-external-model-7bcdc9f9cc-wnf8n

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-wnf8n

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-wnf8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-wnf8n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 4 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

Started

Container started

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x4)

models-as-a-service

kubelet

payload-processing-external-model-7cd8774477-vdcld

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-aa8816631626" not found

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-wnf8n

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7bcdc9f9cc

SuccessfulDelete

Deleted pod: payload-processing-external-model-7bcdc9f9cc-wnf8n

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7bcdc9f9cc from 1 to 0
(x8)

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-wnf8n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

replicaset-controller

payload-processing-external-model-657c7b7984

SuccessfulCreate

Created pod: payload-processing-external-model-657c7b7984-zkcf6

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-657c7b7984 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-657c7b7984-zkcf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-657c7b7984-zkcf6

Started

Container started

models-as-a-service

multus

payload-processing-external-model-657c7b7984-zkcf6

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-657c7b7984-zkcf6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7cd8774477-vdcld

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7cd8774477 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-7cd8774477

SuccessfulDelete

Deleted pod: payload-processing-external-model-7cd8774477-vdcld

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7bcdc9f9cc from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-7bcdc9f9cc

SuccessfulCreate

Created pod: payload-processing-external-model-7bcdc9f9cc-bkxqq

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-bkxqq

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-bkxqq

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-bkxqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7bcdc9f9cc-bkxqq

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

models-as-a-service

kubelet

payload-processing-external-model-657c7b7984-zkcf6

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-282885dac35a" not found, secret "agc-cred-43bfee711d1b" not found]
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x2)

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-bkxqq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-7bcdc9f9cc-bkxqq

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-657c7b7984-zkcf6

Killing

Stopping container payload-processing
(x2)

models-as-a-service

kubelet

payload-processing-external-model-657c7b7984-zkcf6

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-282885dac35a" not found, secret "agc-cred-43bfee711d1b" not found, secret "agc-cred-a2f1ffbe7a37" not found]

openshift-ingress

multus

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulCreate

Created pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 6 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

Started

Container started

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

Started

Container started

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulCreate

Created pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Created

Container created

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Started

Container started

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Started

Container started

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 8 to 9

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Unhealthy

Readiness probe failed: Get "https://10.133.0.56:8000/ready": context deadline exceeded
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-f7c92a85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f7c92a85-openshift-default-59bf496589 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-f7c92a85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f7c92a85

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

Unhealthy

Readiness probe failed: Get "http://10.133.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

ProbeError

Readiness probe error: Get "http://10.133.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-0144bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0144bd-openshift-default-67b9448dc from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulCreate

Created pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulCreate

Created pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

Created

Container created

openshift-ingress

multus

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 9 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f7c92a85: serviceaccount "payload-processing-e2e-mt-f7c92a85" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f7c92a85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f7c92a85-67769656df from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f7c92a85-67769656df

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f7c92a85-67769656df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f7c92a85: serviceaccount "payload-processing-e2e-mt-f7c92a85" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f7c92a85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc from 0 to 1

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f7c92a85-67769656df

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

openshift-ingress

multus

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 1 to 2

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Unhealthy

Liveness probe failed: Get "https://10.133.0.56:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

Unhealthy

Readiness probe failed: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

ProbeError

Readiness probe error: Get "http://10.133.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Unhealthy

Readiness probe failed: Get "http://10.133.0.117:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

ProbeError

Readiness probe error: Get "http://10.133.0.117:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Unhealthy

Readiness probe failed: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

ProbeError

Readiness probe error: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x2)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-59cxw

Unhealthy

Readiness probe failed: Get "https://10.133.0.56:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9

SuccessfulCreate

Created pod: e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

openshift-ingress

gateway_labeler_controller

e2e-api-a-a4dc2e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a4dc2e

openshift-ingress

deployment-controller

e2e-api-a-a4dc2e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a4dc2e-openshift-default-74d88b7bf9 from 0 to 1

openshift-ingress

multus

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a4dc2e: serviceaccount "payload-processing-e2e-api-a-a4dc2e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a4dc2e-7c9cc6457

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a4dc2e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a4dc2e-6768b689f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a4dc2e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a4dc2e-7c9cc6457 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a4dc2e-7c9cc6457

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a4dc2e-7c9cc6457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a4dc2e: serviceaccount "payload-processing-e2e-api-a-a4dc2e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f7c92a85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f7c92a85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-a-835921

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-835921

openshift-ingress

deployment-controller

e2e-api-a-835921-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-835921-openshift-default-58b55c7f6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-835921-openshift-default-58b55c7f6f

SuccessfulCreate

Created pod: e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

openshift-ingress

multus

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-835921-bfccbc495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-835921-bfccbc495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-835921: serviceaccount "payload-processing-e2e-api-a-835921" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-835921

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-835921-bfccbc495 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-835921

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-835921-5495c6d7dc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-835921-5495c6d7dc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-835921-5495c6d7dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-835921: serviceaccount "payload-processing-e2e-api-a-835921" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-835921-5495c6d7dc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6

openshift-ingress

multus

payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-835921-bfccbc495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6

openshift-ingress

kubelet

payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

Created

Container created

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-835921-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-835921-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-2ccdde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2ccdde-openshift-default-87bd7f9df from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-2ccdde-openshift-default-87bd7f9df

SuccessfulCreate

Created pod: e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

openshift-ingress

gateway_labeler_controller

e2e-api-b-2ccdde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2ccdde

openshift-ingress

multus

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a4dc2e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a4dc2e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2ccdde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2ccdde-8595f9fdd7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2ccdde-8595f9fdd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2ccdde: serviceaccount "payload-processing-e2e-api-b-2ccdde" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2ccdde-8595f9fdd7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2ccdde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2ccdde-8595f9fdd7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2ccdde: serviceaccount "payload-processing-e2e-api-b-2ccdde" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a4dc2e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-a4dc2e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lvhqt

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lvhqt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lvhqt

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-f7c92a85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f7c92a85-openshift-default-59bf496589 from 1 to 2

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f7c92a85-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lvhqt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.643s (4.643s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lvhqt

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

Started

Container started

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lvhqt

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2ccdde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2ccdde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7504-d00901

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

Started

Container started

opendatahub

kubelet

test-curl-7504-d00901

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x2)

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

Created

Container created

opendatahub

kubelet

test-curl-7504-d00901

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.151s (3.151s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7504-d00901

Created

Container created

opendatahub

kubelet

test-curl-7504-d00901

Started

Container started

opendatahub

kubelet

test-curl-7504-d00901

Killing

Stopping container test-curl-7504-d00901
(x6)

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulCreate

Created pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 4 to 8

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-a-3e7872

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-3e7872

openshift-ingress

deployment-controller

e2e-api-a-3e7872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-3e7872-openshift-default-5d6b959b4f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-3e7872-openshift-default-5d6b959b4f

SuccessfulCreate

Created pod: e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

openshift-ingress

multus

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-2a59a7-openshift-default-56675cf64f

SuccessfulCreate

Created pod: e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

openshift-ingress

deployment-controller

e2e-api-b-2a59a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2a59a7-openshift-default-56675cf64f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-2a59a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2a59a7

openshift-ingress

multus

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

Killing

Stopping container payload-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3e7872-67cf679bc9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-3e7872-67cf679bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3e7872: serviceaccount "payload-processing-e2e-api-a-3e7872" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3e7872: serviceaccount "payload-processing-e2e-api-a-3e7872" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-3e7872

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-835921-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-3e7872

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-3e7872-67cf679bc9 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-835921-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3e7872-67cf679bc9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf

SuccessfulCreate

Created pod: e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

openshift-ingress

deployment-controller

e2e-ipp-a-bba5ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bba5ed-openshift-default-587c8c7bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bba5ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bba5ed

openshift-ingress

multus

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2a59a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2a59a7-7fb7b7bb7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2a59a7: serviceaccount "payload-processing-e2e-api-b-2a59a7" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2a59a7: serviceaccount "payload-processing-e2e-api-b-2a59a7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2a59a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2a59a7-8b96b4675 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs

openshift-ingress

multus

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bba5ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bba5ed-57d4564ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bba5ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bba5ed: serviceaccount "payload-processing-e2e-ipp-a-bba5ed" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bba5ed-57d4564ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bba5ed-57d4564ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bba5ed-57d4564ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bba5ed: serviceaccount "payload-processing-e2e-ipp-a-bba5ed" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-l6sgx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-7kjb8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

Unhealthy

Readiness probe failed: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

ProbeError

Readiness probe error: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-a4dc2e-7c9cc6457-2dmdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a4dc2e-6768b689f-4xwmz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2ccdde-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2ccdde-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3e7872-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3e7872-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

Unhealthy

Startup probe failed: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

ProbeError

Startup probe error: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f7c92a85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f7c92a85-67769656df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f7c92a85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f7c92a85-67769656df

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f7c92a85-67769656df-q75qn
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f7c92a85-67769656df

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f7c92a85-67769656df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f7c92a85: serviceaccount "payload-processing-e2e-mt-f7c92a85" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f7c92a85: serviceaccount "payload-processing-e2e-mt-f7c92a85" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-q75qn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-f7c92a85-67769656df-q75qn

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-q75qn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-q75qn

Started

Container started

openshift-ingress

deployment-controller

e2e-api-b-2cda64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2cda64-openshift-default-dbd549c6c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-2cda64-openshift-default-dbd549c6c

SuccessfulCreate

Created pod: e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

openshift-ingress

gateway_labeler_controller

e2e-api-b-2cda64

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2cda64

openshift-ingress

multus

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-0144bd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0144bd-openshift-default-67b9448dc from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulDelete

Deleted pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-zhfpb
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3e7872-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-3e7872-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2cda64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2cda64-8599f5c5fc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2cda64: serviceaccount "payload-processing-e2e-api-b-2cda64" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2cda64-8599f5c5fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2cda64-8599f5c5fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2cda64: serviceaccount "payload-processing-e2e-api-b-2cda64" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2cda64-8599f5c5fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2cda64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-ncrxw

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-7c2n9

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lzdgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 10 to 6
(x6)

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

Unhealthy

Readiness probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qsz7h

ProbeError

Readiness probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-n9hqt

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-835921-bfccbc495-cjbl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

openshift-ingress

kubelet

payload-processing-e2e-api-a-835921-5495c6d7dc-gz5g6

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-28ks6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 10 to 6

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-70babe-openshift-default-664c65585f

SuccessfulCreate

Created pod: e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-70babe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-70babe

openshift-ingress

deployment-controller

e2e-ipp-b-70babe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-70babe-openshift-default-664c65585f from 0 to 1

openshift-ingress

multus

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-5cbb9b5ccf-lndr7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-57d4564ff-dg2lz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-crp5c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

Unhealthy

Readiness probe failed: Get "http://10.133.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-8qmr2

ProbeError

Readiness probe error: Get "http://10.133.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bba5ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bba5ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-70babe: serviceaccount "payload-processing-e2e-ipp-b-70babe" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-70babe-7d684ff48f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-70babe-7d684ff48f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-70babe: serviceaccount "payload-processing-e2e-ipp-b-70babe" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-70babe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-70babe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-70babe-7d684ff48f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-70babe-7d684ff48f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2a59a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2a59a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-a4dc2e-openshift-default-74d88b7bf9-rj76m

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2a59a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2a59a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2ccdde-65dcc85c9-254dq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2ccdde-8595f9fdd7-vprsq

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bba5ed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-bba5ed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

ProbeError

Readiness probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-5tndp

Unhealthy

Readiness probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f7c92a85-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

openshift-ingress

deployment-controller

e2e-mt-f7c92a85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f7c92a85-openshift-default-59bf496589 from 2 to 4

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

Started

Container started

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 9 to 6

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bba5ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bba5ed-7457c998b8 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bba5ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bba5ed: serviceaccount "payload-processing-e2e-ipp-a-bba5ed" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bba5ed-7457c998b8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bba5ed-7457c998b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bba5ed: serviceaccount "payload-processing-e2e-ipp-a-bba5ed" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-66bc9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-9nmtp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bba5ed-7457c998b8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-j67vs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f7c92a85-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-mt-f7c92a85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f7c92a85-openshift-default-59bf496589 from 4 to 8

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 6.187s (6.187s including waiting). Image size: 166620835 bytes.

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

Started

Container started

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 5.406s (5.406s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

Started

Container started

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

Started

Container started

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

Started

Container started

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

Started

Container started

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

ProbeError

Readiness probe error: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

Unhealthy

Readiness probe failed: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

Unhealthy

Startup probe failed: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

ProbeError

Startup probe error: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-f7c92a85-openshift-default

SuccessfulRescale

New size: 10; reason:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2cda64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2cda64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-mt-f7c92a85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f7c92a85-openshift-default-59bf496589 from 8 to 10

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

Created

Container created

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

Started

Container started

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-f7c92a85-openshift-default-59bf496589

SuccessfulCreate

(combined from similar events): Created pod: e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

openshift-ingress

multus

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

Unhealthy

Startup probe failed: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

ProbeError

Startup probe error: Get "http://10.133.0.165:15021/healthz/ready": dial tcp 10.133.0.165:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7504-5eab08

Created

Container created

opendatahub

kubelet

test-curl-7504-5eab08

Started

Container started

opendatahub

multus

test-curl-7504-5eab08

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7504-5eab08

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7504-5eab08

Killing

Stopping container test-curl-7504-5eab08

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2cda64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-835921-openshift-default-58b55c7f6f-l7tbn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2cda64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f7c92a85-7b65f87cdc-dgh8b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f7c92a85-67769656df-q75qn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2a59a7-8b96b4675-hpfjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2a59a7-7fb7b7bb7-rcnkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

Unhealthy

Readiness probe failed: Get "http://10.133.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

ProbeError

Readiness probe error: Get "http://10.133.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-cpsx2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-4znwv

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-j6ldv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58c6585447 from 10 to 7
(x6)

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

Unhealthy

Startup probe failed: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

ProbeError

Startup probe error: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-4znwv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-cpsx2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-j6ldv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-70babe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-70babe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3e7872-65f9df4c8c-c5q8f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-3e7872-67cf679bc9-fq47g

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-70babe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-70babe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-7d684ff48f-ncsds

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-7c7b65b4c9-fswpv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-2ccdde-openshift-default-87bd7f9df-9xlfj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997

SuccessfulCreate

Created pod: e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

openshift-ingress

deployment-controller

e2e-ipp-a-f6a8a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f6a8a5-openshift-default-7584b4d997 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f6a8a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f6a8a5

openshift-ingress

multus

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f6a8a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f6a8a5: serviceaccount "payload-processing-e2e-ipp-a-f6a8a5" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f6a8a5: serviceaccount "payload-processing-e2e-ipp-a-f6a8a5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f6a8a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f6a8a5-b947fdc59 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml

openshift-ingress

multus

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulDelete

Deleted pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 8 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulDelete

Deleted pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-m99jj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulDelete

Deleted pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-977vb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-jgxm7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulDelete

Deleted pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-68pck

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-70babe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-70babe-cb57d9d6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-70babe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-70babe-78d784d879 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-70babe-78d784d879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-70babe-78d784d879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-70babe: serviceaccount "payload-processing-e2e-ipp-b-70babe" not found

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-0144bd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0144bd-openshift-default-67b9448dc from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulDelete

Deleted pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-70babe-cb57d9d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-70babe-cb57d9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-70babe: serviceaccount "payload-processing-e2e-ipp-b-70babe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-70babe-78d784d879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-70babe-cb57d9d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-gltnm

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58c6585447 from 7 to 6

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 6 to 4

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-gjnsd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-db92l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

openshift-ingress

gateway_labeler_controller

e2e-api-a-752be8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-752be8

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-752be8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-752be8-openshift-default-79688d7695 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lrcx7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-qrcjg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 6 to 4

openshift-ingress

replicaset-controller

e2e-api-a-752be8-openshift-default-79688d7695

SuccessfulCreate

Created pod: e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-bct8b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-q2b2t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-knvnq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-tqsg2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-9jn9l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-4hd74

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-h24zn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-gltnm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-fj5mf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f7c92a85-openshift-default-59bf496589-2rckm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-z5fl2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rqmlw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 6 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-752be8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-752be8-7644cdf87c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-752be8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-752be8-856789d5cf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-752be8-7644cdf87c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-752be8-7644cdf87c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-752be8: serviceaccount "payload-processing-e2e-api-a-752be8" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-752be8-856789d5cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-752be8-856789d5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-752be8: serviceaccount "payload-processing-e2e-api-a-752be8" not found

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-752be8-7644cdf87c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-752be8-856789d5cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-5nbds

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-wrcjg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-3e7872-openshift-default-5d6b959b4f-l77bp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-2a59a7-openshift-default-56675cf64f-ktm7l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-97fc39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-97fc39-openshift-default-758f6d5565 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-97fc39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-97fc39

openshift-ingress

replicaset-controller

e2e-ipp-a-97fc39-openshift-default-758f6d5565

SuccessfulCreate

Created pod: e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

openshift-ingress

multus

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2cda64-5c4c7bc8d7-c2sjg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2cda64-8599f5c5fc-dl84g

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-97fc39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97fc39: serviceaccount "payload-processing-e2e-ipp-a-97fc39" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-97fc39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-97fc39-687d7d4d75 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97fc39-687d7d4d75

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-97fc39-687d7d4d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97fc39: serviceaccount "payload-processing-e2e-ipp-a-97fc39" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt

openshift-ingress

multus

payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97fc39-687d7d4d75

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f6a8a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f6a8a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-752be8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-752be8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-b947fdc59-dfkml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-858cb8766c-8vlf5

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f6a8a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f6a8a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-sgb5m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 4 to 3

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl
(x2)

openshift-ingress

kubelet

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-qppxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-752be8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-752be8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-726d5b-openshift-default-78ddc5479

SuccessfulCreate

Created pod: e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

openshift-ingress

gateway_labeler_controller

e2e-api-b-726d5b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-726d5b

openshift-ingress

deployment-controller

e2e-api-b-726d5b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-726d5b-openshift-default-78ddc5479 from 0 to 1

openshift-ingress

multus

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58c6585447 from 6 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulDelete

Deleted pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-thkzr

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 4 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-6bnvm
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-thkzr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-6bnvm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-726d5b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-726d5b-bb84b569c from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-sddxw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-726d5b-bb84b569c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-726d5b-bb84b569c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-726d5b: serviceaccount "payload-processing-e2e-api-b-726d5b" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-726d5b-6477c9868c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-726d5b-6477c9868c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-726d5b: serviceaccount "payload-processing-e2e-api-b-726d5b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-726d5b-6477c9868c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-726d5b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-726d5b-6477c9868c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-726d5b-bb84b569c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-97fc39-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-97fc39-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-2cda64-openshift-default-dbd549c6c-nvwzd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-f9d9fd5dc-82kxt

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f6a8a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f6a8a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f6a8a5-5c49db7868 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-687d7d4d75-fp6f9

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-2c02a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2c02a9-openshift-default-58744dbc8c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c

SuccessfulCreate

Created pod: e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2c02a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2c02a9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-qq4mp

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58c6585447 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f6a8a5: serviceaccount "payload-processing-e2e-ipp-a-f6a8a5" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f6a8a5: serviceaccount "payload-processing-e2e-ipp-a-f6a8a5" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb

Created

Container created

openshift-ingress

multus

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-qq4mp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zsmgv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2c02a9: serviceaccount "payload-processing-e2e-ipp-b-2c02a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2c02a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2c02a9-5db8c685c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2c02a9-5db8c685c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2c02a9-5db8c685c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2c02a9: serviceaccount "payload-processing-e2e-ipp-b-2c02a9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2c02a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2c02a9-5db8c685c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-87b0f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-87b0f8-openshift-default-75b85b8965 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-87b0f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-87b0f8

openshift-ingress

replicaset-controller

e2e-praxis-a-87b0f8-openshift-default-75b85b8965

SuccessfulCreate

Created pod: e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-1a4f30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-1a4f30

openshift-ingress

replicaset-controller

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599

SuccessfulCreate

Created pod: e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

openshift-ingress

deployment-controller

e2e-ipp-b-1a4f30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-1a4f30-openshift-default-84bc5b7599 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-87b0f8: serviceaccount "payload-processing-e2e-praxis-a-87b0f8" not found

openshift-ingress

multus

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-87b0f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-87b0f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-87b0f8-d456cbfbf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-87b0f8: serviceaccount "payload-processing-e2e-praxis-a-87b0f8" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

openshift-ingress

multus

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1a4f30: serviceaccount "payload-processing-e2e-ipp-b-1a4f30" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1a4f30: serviceaccount "payload-processing-e2e-ipp-b-1a4f30" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1a4f30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1a4f30-74d66f7d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1a4f30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87b0f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87b0f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-97fc39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-97fc39-79cbf8f648 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97fc39: serviceaccount "payload-processing-e2e-ipp-a-97fc39" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-97fc39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97fc39-79cbf8f648

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-97fc39-79cbf8f648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97fc39: serviceaccount "payload-processing-e2e-ipp-a-97fc39" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97fc39-79cbf8f648

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.842s (2.842s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Started

Container started

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Unhealthy

Readiness probe failed: Get "http://10.132.0.103:15021/healthz/ready": read tcp 10.132.0.2:49450->10.132.0.103:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

ProbeError

Readiness probe error: Get "http://10.132.0.103:15021/healthz/ready": read tcp 10.132.0.2:49450->10.132.0.103:15021: read: connection reset by peer body:
(x6)

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-726d5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-726d5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-726d5b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-726d5b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Unhealthy

Readiness probe failed: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

ProbeError

Readiness probe error: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulDelete

Deleted pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 3 to 2
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-xbbwk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-752be8-856789d5cf-bhfnt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-752be8-7644cdf87c-8xh6s

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87b0f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87b0f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bba5ed-65fc4b9fdc-b4s5l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bba5ed-7457c998b8-t4s2t

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2c02a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2c02a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zvlvd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1a4f30-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-989s5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1a4f30-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-59b8b5c7cf-blh5v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-5db8c685c-sprt6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-f7s5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-868b06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-868b06

openshift-ingress

deployment-controller

e2e-praxis-b-868b06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-868b06-openshift-default-58984b7645 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-868b06-openshift-default-58984b7645

SuccessfulCreate

Created pod: e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

openshift-ingress

multus

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1a4f30-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-1a4f30-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-868b06-c7c87d669

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-868b06-c7c87d669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-868b06: serviceaccount "payload-processing-e2e-praxis-b-868b06" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-868b06-c7c87d669

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-868b06: serviceaccount "payload-processing-e2e-praxis-b-868b06" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-868b06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-868b06-c7c87d669 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-868b06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-74d66f7d5-j9p29

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-645bd9c455-ppgfg

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58c6585447 from 3 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-7v26z

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-7v26z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bba5ed-openshift-default-587c8c7bf-qwq76

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97fc39-79cbf8f648-l5gcw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97fc39-6bcb6c79cf-gscs6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-97fc39-openshift-default-758f6d5565-fsf92

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2c02a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2c02a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2c02a9: serviceaccount "payload-processing-e2e-ipp-b-2c02a9" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2c02a9: serviceaccount "payload-processing-e2e-ipp-b-2c02a9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls

openshift-ingress

multus

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-70babe-cb57d9d6-ppxxl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-70babe-78d784d879-c7mn4

Unhealthy

Readiness probe failed: dial tcp 10.133.0.170:9004: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-1a4f30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-1a4f30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-1a4f30-77b6c6c978 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1a4f30: serviceaccount "payload-processing-e2e-ipp-b-1a4f30" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-1a4f30: serviceaccount "payload-processing-e2e-ipp-b-1a4f30" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-70babe-openshift-default-664c65585f-2zskj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-38dd3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-38dd3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-38dd3e

openshift-ingress

replicaset-controller

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c

SuccessfulCreate

Created pod: e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

openshift-ingress

multus

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-38dd3e-759ddf7657

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-38dd3e-759ddf7657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-38dd3e: serviceaccount "payload-processing-e2e-praxis-a-38dd3e" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-38dd3e: serviceaccount "payload-processing-e2e-praxis-a-38dd3e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-38dd3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-38dd3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-38dd3e-759ddf7657 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-38dd3e-759ddf7657

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

openshift-ingress

multus

payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

Created

Container created

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-752be8-openshift-default-79688d7695-mvqqp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f6a8a5-5c49db7868-qdwzw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f6a8a5-9bfd69b6c-fx2cb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2c02a9-795bf5b9fd-rdd6b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2c02a9-6b44499ff9-lrvls

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-726d5b-bb84b569c-9wn4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-726d5b-6477c9868c-sv2rd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-f6a8a5-openshift-default-7584b4d997-jhjq4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-868b06-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-868b06-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-7ae676-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-7ae676-openshift-default-574fcf9f57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-7ae676

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-7ae676

openshift-ingress

replicaset-controller

e2e-praxis-a-7ae676-openshift-default-574fcf9f57

SuccessfulCreate

Created pod: e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

openshift-ingress

multus

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

Unhealthy

Readiness probe failed: Get "http://10.133.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-2c02a9-openshift-default-58744dbc8c-tqxzd

ProbeError

Readiness probe error: Get "http://10.133.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-7ae676

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-7ae676

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-7ae676-854c474479 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7ae676-854c474479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-7ae676-854c474479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-7ae676-854c474479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7ae676: serviceaccount "payload-processing-e2e-praxis-a-7ae676" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-7ae676: serviceaccount "payload-processing-e2e-praxis-a-7ae676" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-1a4f30-689dbb59f9-cqhss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-1a4f30-77b6c6c978-4vvll

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-868b06-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-868b06-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-1a4f30-openshift-default-84bc5b7599-pbgcn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-6a693b-openshift-default-857bd997b5

SuccessfulCreate

Created pod: e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-6a693b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-6a693b

openshift-ingress

deployment-controller

e2e-praxis-a-6a693b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-6a693b-openshift-default-857bd997b5 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6a693b: serviceaccount "payload-processing-e2e-praxis-a-6a693b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-6a693b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-6a693b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-6a693b-65cb466b5c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6a693b-65cb466b5c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6a693b-65cb466b5c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-6a693b-65cb466b5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6a693b: serviceaccount "payload-processing-e2e-praxis-a-6a693b" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lvhqt

Killing

Stopping container discovery

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-lvhqt

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulDelete

Deleted pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-bdp2g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dbxkz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a693b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a693b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c

SuccessfulDelete

Deleted pod: e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-7abb95-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-7abb95-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-7abb95-openshift-default-7ddb974b4c from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-10a7aa-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w0-10a7aa-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-10a7aa-openshift-default-8d4bff587 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-10a7aa-openshift-default-8d4bff587

SuccessfulDelete

Deleted pod: e2e-worker-w0-10a7aa-openshift-default-8d4bff587-tkrwp

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-9cvqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

Unhealthy

Startup probe failed: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

ProbeError

Startup probe error: Get "http://10.133.0.186:15021/healthz/ready": dial tcp 10.133.0.186:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ef8827

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ef8827

openshift-ingress

replicaset-controller

e2e-praxis-b-ef8827-openshift-default-6f86df96f

SuccessfulCreate

Created pod: e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

openshift-ingress

deployment-controller

e2e-praxis-b-ef8827-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ef8827-openshift-default-6f86df96f from 0 to 1

openshift-ingress

multus

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38dd3e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38dd3e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ae676-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ae676-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ef8827

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ef8827: serviceaccount "payload-processing-e2e-praxis-b-ef8827" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ef8827

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ef8827-5686ffd4f7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ef8827: serviceaccount "payload-processing-e2e-praxis-b-ef8827" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38dd3e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38dd3e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

Unhealthy

Readiness probe failed: Get "http://10.133.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

ProbeError

Readiness probe error: Get "http://10.133.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

Started

Container started

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-726d5b-openshift-default-78ddc5479-nqmmb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ae676-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-7ae676-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-31144e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-31144e

openshift-ingress

multus

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-31144e-openshift-default-5b4f97fc57

SuccessfulCreate

Created pod: e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

openshift-ingress

deployment-controller

e2e-praxis-b-31144e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-31144e-openshift-default-5b4f97fc57 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-31144e-7c4db79977

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-31144e-7c4db79977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-31144e: serviceaccount "payload-processing-e2e-praxis-b-31144e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-31144e-7c4db79977

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-31144e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-31144e-75df7b549f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-31144e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-31144e-7c4db79977 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-31144e: serviceaccount "payload-processing-e2e-praxis-b-31144e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-bfpd7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c

SuccessfulCreate

Created pod: e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

openshift-ingress

deployment-controller

e2e-praxis-b-bf38e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-bf38e4-openshift-default-5d6c55845c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-bf38e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-bf38e4
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a693b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a693b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-bf38e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-bf38e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-bf38e4-78664cc9b5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bf38e4: serviceaccount "payload-processing-e2e-praxis-b-bf38e4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-bf38e4: serviceaccount "payload-processing-e2e-praxis-b-bf38e4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ef8827-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ef8827-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87b0f8-d456cbfbf-8wrkc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87b0f8-57f5446959-7d8rs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ef8827-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ef8827-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38dd3e-759ddf7657-hlj7f

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.187:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38dd3e-545b56d899-xqfzv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.188:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

Unhealthy

Startup probe failed: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

Unhealthy

Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

ProbeError

Startup probe error: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

ProbeError

Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

Unhealthy

Startup probe failed: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

ProbeError

Startup probe error: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-31144e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-31144e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bf38e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bf38e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-38dd3e-openshift-default-65bd7fdb9c-6ph5k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-7ae676-8bbc7fb4c-tfpwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-7ae676-854c474479-jh55d

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bf38e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-bf38e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ef8827-5686ffd4f7-tf9tm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ef8827-7fd8bd4ddc-bqskw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a693b-7db7bc7b47-bg5ts

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a693b-65cb466b5c-qcxwz

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-7ae676-openshift-default-574fcf9f57-6g6jd

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

Unhealthy

Startup probe failed: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

ProbeError

Startup probe error: Get "http://10.133.0.205:15021/healthz/ready": dial tcp 10.133.0.205:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-31144e-7c4db79977-cnbx5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-31144e-75df7b549f-gzjqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-6a693b-openshift-default-857bd997b5-vgzfk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58c6585447-kf9dc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58c6585447 from 2 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58c6585447

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58c6585447-kf9dc

openshift-ingress

kubelet

e2e-praxis-b-ef8827-openshift-default-6f86df96f-rlggh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-bf38e4-77fff9db6c-lrg2p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-bf38e4-78664cc9b5-2cx2t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-87b0f8-openshift-default-75b85b8965-kzm5b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-868b06-649dbfcd47-vwl6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-868b06-c7c87d669-5htx9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-31144e-openshift-default-5b4f97fc57-rv8kk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-bf38e4-openshift-default-5d6c55845c-zg9gw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulCreate

Created pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-cfc055

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-cfc055

openshift-ingress

replicaset-controller

e2e-shared-a-w0-cfc055-openshift-default-75ff966979

SuccessfulCreate

Created pod: e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

openshift-ingress

deployment-controller

e2e-shared-a-w0-cfc055-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-cfc055-openshift-default-75ff966979 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-f13553

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-f13553

openshift-ingress

replicaset-controller

e2e-shared-a-w3-f13553-openshift-default-55679f5995

SuccessfulCreate

Created pod: e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

openshift-ingress

deployment-controller

e2e-shared-a-w3-f13553-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-f13553-openshift-default-55679f5995 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-cfc055

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-cfc055: serviceaccount "payload-processing-e2e-shared-a-w0-cfc055" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-cfc055: serviceaccount "payload-processing-e2e-shared-a-w0-cfc055" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-cfc055

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f13553: serviceaccount "payload-processing-e2e-shared-a-w3-f13553" not found

openshift-ingress

kubelet

e2e-praxis-b-868b06-openshift-default-58984b7645-274sp

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f13553: serviceaccount "payload-processing-e2e-shared-a-w3-f13553" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-f13553

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-f13553

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-f13553-5c9c47774f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-16b984

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-16b984

openshift-ingress

deployment-controller

e2e-shared-a-w2-16b984-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-16b984-openshift-default-786bf945ff from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-16b984-openshift-default-786bf945ff

SuccessfulCreate

Created pod: e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

openshift-ingress

multus

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-16b984

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-16b984: serviceaccount "payload-processing-e2e-shared-a-w2-16b984" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-16b984

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-16b984-84f95b458f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-16b984-84f95b458f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-16b984-84f95b458f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-16b984: serviceaccount "payload-processing-e2e-shared-a-w2-16b984" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-16b984-84f95b458f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-a-w4-4743f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-4743f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-4743f8

openshift-ingress

replicaset-controller

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5

SuccessfulCreate

Created pod: e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

openshift-ingress

multus

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulCreate

Created pod: e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

Started

Container started

openshift-ingress

multus

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-4743f8: serviceaccount "payload-processing-e2e-shared-a-w4-4743f8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-4743f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-4743f8: serviceaccount "payload-processing-e2e-shared-a-w4-4743f8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-4743f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-1a1181

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-1a1181

openshift-ingress

deployment-controller

e2e-autores-1a1181-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-1a1181-openshift-default-7996f77b8f from 0 to 1

openshift-ingress

multus

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-1a1181-openshift-default-7996f77b8f

SuccessfulCreate

Created pod: e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-0144bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0144bd-openshift-default-67b9448dc from 1 to 2
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulCreate

Created pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

openshift-ingress

multus

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1a1181-84cc549df9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-1a1181-84cc549df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1a1181: serviceaccount "payload-processing-e2e-autores-1a1181" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1a1181-6b6b84fcc9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-1a1181-6b6b84fcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1a1181: serviceaccount "payload-processing-e2e-autores-1a1181" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-1a1181

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-1a1181-6b6b84fcc9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-1a1181

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-1a1181-84cc549df9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1a1181-6b6b84fcc9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj

openshift-ingress

multus

payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1a1181-84cc549df9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt

openshift-ingress

kubelet

payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cfc055-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cfc055-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

ProbeError

Startup probe error: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

Unhealthy

Startup probe failed: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587

SuccessfulCreate

Created pod: e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-c6b3b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-c6b3b9

openshift-ingress

deployment-controller

e2e-shared-b-w0-c6b3b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-c6b3b9-openshift-default-bd978587 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

Unhealthy

Readiness probe failed: Get "http://10.133.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4e1a6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4e1a6c

openshift-ingress

deployment-controller

e2e-shared-b-w3-4e1a6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899

SuccessfulCreate

Created pod: e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

ProbeError

Readiness probe error: Get "http://10.133.0.215:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-c6b3b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-c6b3b9: serviceaccount "payload-processing-e2e-shared-b-w0-c6b3b9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-c6b3b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-c6b3b9: serviceaccount "payload-processing-e2e-shared-b-w0-c6b3b9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

ProbeError

Startup probe error: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cfc055-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-cfc055-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

Unhealthy

Startup probe failed: Get "http://10.133.0.215:15021/healthz/ready": dial tcp 10.133.0.215:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4e1a6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

Unhealthy

Startup probe failed: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

ProbeError

Startup probe error: Get "http://10.133.0.213:15021/healthz/ready": dial tcp 10.133.0.213:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4e1a6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-16b984-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-16b984-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4e1a6c: serviceaccount "payload-processing-e2e-shared-b-w3-4e1a6c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4e1a6c: serviceaccount "payload-processing-e2e-shared-b-w3-4e1a6c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f13553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f13553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4743f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4743f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

Unhealthy

Startup probe failed: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

ProbeError

Startup probe error: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-16b984-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-16b984-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w2-bf325c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f13553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc

SuccessfulCreate

Created pod: e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-f13553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-bf325c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-bf325c

openshift-ingress

multus

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-bf325c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-bf325c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-bf325c: serviceaccount "payload-processing-e2e-shared-b-w2-bf325c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-bf325c: serviceaccount "payload-processing-e2e-shared-b-w2-bf325c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8

AddedInterface

Add eth0 [10.133.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4743f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-4743f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

ProbeError

Startup probe error: Get "http://10.133.0.220:15021/healthz/ready": dial tcp 10.133.0.220:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

Unhealthy

Startup probe failed: Get "http://10.133.0.220:15021/healthz/ready": dial tcp 10.133.0.220:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w4-093220-openshift-default-76b9db88df

SuccessfulCreate

Created pod: e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-093220

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-093220

openshift-ingress

deployment-controller

e2e-shared-b-w4-093220-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-093220-openshift-default-76b9db88df from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1a1181-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1a1181-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-093220: serviceaccount "payload-processing-e2e-shared-b-w4-093220" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-093220: serviceaccount "payload-processing-e2e-shared-b-w4-093220" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-093220

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-093220

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-093220-5479b7bbd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1a1181-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-1a1181-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c6b3b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c6b3b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4e1a6c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4e1a6c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c6b3b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c6b3b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4e1a6c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-4e1a6c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

Unhealthy

Readiness probe failed: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

ProbeError

Readiness probe error: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-bf325c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-bf325c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-autores-1a1181-6b6b84fcc9-zvgrj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1a1181-84cc549df9-ql2tt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-bf325c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-bf325c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-093220-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-093220-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-093220-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-093220-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-1a1181-openshift-default-7996f77b8f-djtr9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-ee480f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ee480f

openshift-ingress

deployment-controller

e2e-noten-ee480f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ee480f-openshift-default-fbf7769b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-ee480f-openshift-default-fbf7769b9

SuccessfulCreate

Created pod: e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd

openshift-ingress

kubelet

e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd

Started

Container started

openshift-ingress

kubelet

e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd

Created

Container created

openshift-ingress

multus

e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ee480f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-ee480f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-869cca-openshift-default-86459965cf

SuccessfulDelete

Deleted pod: e2e-worker-w1-869cca-openshift-default-86459965cf-dxrwn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-869cca-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-869cca-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-869cca-openshift-default-86459965cf from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-lk5xf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-6tthv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-qt6lc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-8l8m6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

Unhealthy

Readiness probe failed: Get "http://10.133.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-87x5d

ProbeError

Readiness probe error: Get "http://10.133.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0144bd-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-0144bd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0144bd-openshift-default-67b9448dc from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-0144bd-openshift-default-67b9448dc

SuccessfulDelete

Deleted pod: e2e-worker-w4-0144bd-openshift-default-67b9448dc-s7nm7

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

ProbeError

Readiness probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-wg8fx

Unhealthy

Readiness probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-ee480f-openshift-default-fbf7769b9-9h2xd

Killing

Stopping container istio-proxy

opendatahub

multus

test-curl-7501-08240e

AddedInterface

Add eth0 [10.133.0.233/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7501-08240e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7501-08240e

Created

Container created

opendatahub

kubelet

test-curl-7501-08240e

Started

Container started

opendatahub

kubelet

test-curl-7501-08240e

Killing

Stopping container test-curl-7501-08240e

opendatahub

multus

test-curl-7501-188b00

AddedInterface

Add eth0 [10.133.0.234/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7501-188b00

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7501-188b00

Created

Container created

opendatahub

kubelet

test-curl-7501-188b00

Started

Container started

opendatahub

kubelet

test-curl-7501-188b00

Killing

Stopping container test-curl-7501-188b00

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-a7eb09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-a7eb09

openshift-ingress

deployment-controller

e2e-shared-a-w1-a7eb09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845

SuccessfulCreate

Created pod: e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

openshift-ingress

multus

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-a7eb09: serviceaccount "payload-processing-e2e-shared-a-w1-a7eb09" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-a7eb09: serviceaccount "payload-processing-e2e-shared-a-w1-a7eb09" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-a7eb09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-a7eb09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42

AddedInterface

Add eth0 [10.133.0.236/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk

AddedInterface

Add eth0 [10.133.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a7eb09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a7eb09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w2-bf325c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc

SuccessfulCreate

Created pod: e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-bf325c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

Unhealthy

Startup probe failed: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

ProbeError

Startup probe error: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

ProbeError

Startup probe error: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

Unhealthy

Startup probe failed: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused

opendatahub

multus

test-curl-7498-2ac3b3

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7498-2ac3b3

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7498-2ac3b3

Started

Container started

opendatahub

kubelet

test-curl-7498-2ac3b3

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 6.764s (6.764s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7498-2ac3b3

Created

Container created

opendatahub

multus

test-curl-7498-e26187

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7498-2ac3b3

Killing

Stopping container test-curl-7498-2ac3b3

opendatahub

kubelet

test-curl-7498-e26187

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7498-e26187

Created

Container created

opendatahub

kubelet

test-curl-7498-e26187

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 780ms (780ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7498-e26187

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-e8808d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-e8808d

opendatahub

kubelet

test-curl-7498-e26187

Killing

Stopping container test-curl-7498-e26187

openshift-ingress

multus

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-e8808d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c

SuccessfulCreate

Created pod: e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

opendatahub

kubelet

test-curl-7498-655f87

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7498-655f87

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7498-655f87

Created

Container created

opendatahub

kubelet

test-curl-7498-655f87

Started

Container started

opendatahub

kubelet

test-curl-7498-13087b

Created

Container created

opendatahub

kubelet

test-curl-7498-13087b

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7498-13087b

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7498-655f87

Killing

Stopping container test-curl-7498-655f87

opendatahub

kubelet

test-curl-7498-13087b

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a7eb09-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7498-13087b

Killing

Stopping container test-curl-7498-13087b

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-mjh7b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-e8808d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-a7eb09-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-e8808d: serviceaccount "payload-processing-e2e-shared-b-w1-e8808d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-e8808d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-aaa842-openshift-default-554dcb8797

SuccessfulCreate

Created pod: e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-e8808d: serviceaccount "payload-processing-e2e-shared-b-w1-e8808d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2

openshift-ingress

deployment-controller

e2e-extmod-a-aaa842-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-aaa842-openshift-default-554dcb8797 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-aaa842

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-aaa842

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674

AddedInterface

Add eth0 [10.133.0.245/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-2nv49

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-aaa842

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-aaa842-54699d4bd9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-aaa842

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-aaa842-54699d4bd9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-aaa842-54699d4bd9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-aaa842-54699d4bd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-aaa842: serviceaccount "payload-processing-e2e-extmod-a-aaa842" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-aaa842: serviceaccount "payload-processing-e2e-extmod-a-aaa842" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7504-7e2255

Started

Container started

opendatahub

kubelet

test-curl-7504-7e2255

Created

Container created

opendatahub

multus

test-curl-7504-7e2255

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7504-7e2255

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7504-7e2255

Killing

Stopping container test-curl-7504-7e2255

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-cc6150

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-cc6150

openshift-ingress

replicaset-controller

e2e-extmod-a-cc6150-openshift-default-65645f785

SuccessfulCreate

Created pod: e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

openshift-ingress

deployment-controller

e2e-extmod-a-cc6150-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-cc6150-openshift-default-65645f785 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-cc6150: serviceaccount "payload-processing-e2e-extmod-a-cc6150" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-cc6150

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-cc6150-85d84c4867 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-cc6150-85d84c4867

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-cc6150-85d84c4867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-cc6150: serviceaccount "payload-processing-e2e-extmod-a-cc6150" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-cc6150

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898

openshift-ingress

multus

payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-cc6150-85d84c4867

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

ProbeError

Readiness probe error: Get "http://10.134.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

Unhealthy

Readiness probe failed: Get "http://10.134.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

ProbeError

Startup probe error: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

Unhealthy

Startup probe failed: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e8808d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e8808d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-explicit-5498e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-5498e8

openshift-ingress

replicaset-controller

e2e-explicit-5498e8-openshift-default-55dbb745f7

SuccessfulCreate

Created pod: e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

openshift-ingress

deployment-controller

e2e-explicit-5498e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-5498e8-openshift-default-55dbb745f7 from 0 to 1

openshift-ingress

multus

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-2aebbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-2aebbd

openshift-ingress

deployment-controller

e2e-extmod-a-2aebbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-2aebbd-openshift-default-68cdbb8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f

SuccessfulCreate

Created pod: e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

openshift-ingress

multus

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

AddedInterface

Add eth0 [10.133.0.247/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5498e8-6984fc59c5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-5498e8-6984fc59c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5498e8: serviceaccount "payload-processing-e2e-explicit-5498e8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-5498e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-5498e8-6984fc59c5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5498e8: serviceaccount "payload-processing-e2e-explicit-5498e8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-5498e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-5498e8-bf6796d9f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5498e8-6984fc59c5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d

openshift-ingress

multus

payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d

AddedInterface

Add eth0 [10.133.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

ProbeError

Startup probe error: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

Unhealthy

Startup probe failed: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaa842-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-2aebbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-2aebbd-598945d587 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaa842-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2aebbd-598945d587

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2aebbd: serviceaccount "payload-processing-e2e-extmod-a-2aebbd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-2aebbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2aebbd-598945d587

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-2aebbd-598945d587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2aebbd: serviceaccount "payload-processing-e2e-extmod-a-2aebbd" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e8808d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-e8808d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5498e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5498e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-fae60c-openshift-default-68b4895869

SuccessfulCreate

Created pod: e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e1ca71-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x10)

openshift-ingress

deployment-controller

e2e-worker-w2-e1ca71-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-e1ca71-openshift-default-74d7cc5765 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765

SuccessfulDelete

Deleted pod: e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-fae60c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-fae60c

openshift-ingress

deployment-controller

e2e-extmod-a-fae60c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-fae60c-openshift-default-68b4895869 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-rcbcg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaa842-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-aaa842-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-fae60c: serviceaccount "payload-processing-e2e-extmod-a-fae60c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-fae60c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-fae60c-7f4bb58c89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-fae60c: serviceaccount "payload-processing-e2e-extmod-a-fae60c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-fae60c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-395b06-openshift-default-6644689b57

SuccessfulCreate

Created pod: e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-395b06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-395b06

openshift-ingress

deployment-controller

e2e-extmod-b-395b06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-395b06-openshift-default-6644689b57 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-395b06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-395b06-699bc5d4b7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-395b06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-395b06-57797c564c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-395b06-57797c564c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-395b06-57797c564c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-395b06: serviceaccount "payload-processing-e2e-extmod-b-395b06" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-395b06-57797c564c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-395b06-699bc5d4b7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-395b06-699bc5d4b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-395b06: serviceaccount "payload-processing-e2e-extmod-b-395b06" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-395b06-699bc5d4b7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6
(x2)

openshift-ingress

kubelet

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cc6150-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cc6150-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cc6150-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cc6150-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cc6150-85d84c4867-kgg8f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cc6150-557d4b9667-dt898

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

ProbeError

Readiness probe error: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

Unhealthy

Readiness probe failed: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

Unhealthy

Startup probe failed: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

ProbeError

Startup probe error: Get "http://10.133.0.247:15021/healthz/ready": dial tcp 10.133.0.247:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fae60c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fae60c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-explicit-5498e8-6984fc59c5-9tmmt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5498e8-bf6796d9f-hsl2d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

ProbeError

Readiness probe error: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Unhealthy

Readiness probe failed: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2aebbd-58df5c5dff-42qgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2aebbd-598945d587-gkztt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fae60c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-fae60c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-395b06-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5498e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5498e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-395b06-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-explicit-5498e8-openshift-default-55dbb745f7-brtxz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-3853b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-3853b6

openshift-ingress

deployment-controller

e2e-extmod-a-3853b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-3853b6-openshift-default-758b695749 from 0 to 1
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2aebbd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2aebbd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-3853b6-openshift-default-758b695749

SuccessfulCreate

Created pod: e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

openshift-ingress

kubelet

e2e-extmod-a-2aebbd-openshift-default-68cdbb8f-jfmlg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-3853b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-3853b6-56ff76557c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3853b6: serviceaccount "payload-processing-e2e-extmod-a-3853b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-3853b6-56ff76557c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-3853b6-56ff76557c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3853b6: serviceaccount "payload-processing-e2e-extmod-a-3853b6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-3853b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-3853b6-56ff76557c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-395b06-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-395b06-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-fae60c-7f4bb58c89-thwjj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-fae60c-59d6d4b57f-qjkrv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-cc6150-openshift-default-65645f785-rx5bg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-fae60c-openshift-default-68b4895869-scwnr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-16b984-84f95b458f-sx6v4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-16b984-6758d977c5-hxncb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-aaa842-68b87c5b59-vf5np

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-aaa842-54699d4bd9-mxwrs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-a7eb09-ff54876c-kgl42

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-a7eb09-755bf9b8f5-gmnrk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f13553-5c9c47774f-snc7w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f13553-c87d777c9-4vf2n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-shared-b-w2-bf325c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-bf325c-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

openshift-ingress

kubelet

e2e-shared-a-w2-16b984-openshift-default-786bf945ff-m5bhm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-mzjjf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-a7eb09-openshift-default-6f7fdc5845-jmdxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-f13553-openshift-default-55679f5995-zz98g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-bf325c-56b9c45d8c-4pqfc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-bf325c-5bbfb6885-5dww8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-e8808d-74fc6df98c-x4674

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-e8808d-5c949646b7-gghb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-aaa842-openshift-default-554dcb8797-n87j7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-4e1a6c-openshift-default-5bdff49899-6lx2g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4e1a6c-8445db96c7-sdkdl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4e1a6c-74b7b98f99-8lbsl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

ProbeError

Startup probe error: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

Unhealthy

Startup probe failed: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3853b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3853b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-395b06-699bc5d4b7-n5xn6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-395b06-57797c564c-nfdcn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-bf325c-openshift-default-69d797f5dc-8flzl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-7abb95-685445b999-xx7np

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-7abb95-7d59cf95fc-bwbfg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3853b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3853b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-d7412d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-d7412d

openshift-ingress

deployment-controller

e2e-extmod-b-d7412d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d7412d-openshift-default-58cf4475bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-d7412d-openshift-default-58cf4475bf

SuccessfulCreate

Created pod: e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

AddedInterface

Add eth0 [10.133.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-d7412d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-d7412d-6d7786cfb9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd

AddedInterface

Add eth0 [10.133.0.255/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d7412d: serviceaccount "payload-processing-e2e-extmod-b-d7412d" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d7412d: serviceaccount "payload-processing-e2e-extmod-b-d7412d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-d7412d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

AddedInterface

Add eth0 [10.133.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-e8808d-openshift-default-bdd8b8b7c-6lmp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e1ca71-7d979c7cf5-9l74b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e1ca71-65c459b9dc-pg2pt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

Unhealthy

Readiness probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-395b06-openshift-default-6644689b57-xqt4l

ProbeError

Readiness probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-869cca-5f75cd56c-bhs85

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-869cca-687964869c-4j2vc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-cfc055-5547dd6bbc-cpkfp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-cfc055-5875cc8dbf-qgcwn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-7abb95-openshift-default-7ddb974b4c-nxx2k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d7412d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d7412d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

Unhealthy

Startup probe failed: Get "http://10.133.0.254:15021/healthz/ready": dial tcp 10.133.0.254:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

ProbeError

Startup probe error: Get "http://10.133.0.254:15021/healthz/ready": dial tcp 10.133.0.254:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-e1ca71-openshift-default-74d7cc5765-5bklb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d7412d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d7412d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-cfc055-openshift-default-75ff966979-7wl5x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-869cca-openshift-default-86459965cf-mkh8t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c6b3b9-68f9dbfb57-fnsnn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c6b3b9-8bd66b4c-t248c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-c6b3b9-openshift-default-bd978587-sj449

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-10a7aa-59d6ccbc47-l87q8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-10a7aa-5476fbbfd5-qvj9h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-10a7aa-openshift-default-8d4bff587-zzwww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3853b6-5598d7cf7f-87kpn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3853b6-56ff76557c-qk692

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-3853b6-openshift-default-758b695749-tgg5h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-d7412d-openshift-default-58cf4475bf-22ql7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d7412d-6fdcd6565f-mgcrd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d7412d-6d7786cfb9-n6hpk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-4743f8-5b6b746d7f-j7gmp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-4743f8-7bf4457cd9-kt46l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-4743f8-openshift-default-57c47bdf5-ng4tn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-093220-5479b7bbd7-m6szf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-093220-openshift-default-76b9db88df-tnk9h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-093220-744cc84bb7-blh8v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0144bd-546dccbd5c-tnr5j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0144bd-c955f6b6c-4f6nd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-0144bd-openshift-default-67b9448dc-z4wxs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503