Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5 to ip-10-0-141-86.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-5ff46798db-xzrpd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5ff46798db-xzrpd to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-f84b2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-f84b2 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-fj82z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-fj82z to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

maas-controller-7f9f487f56-qj5rp

Scheduled

Successfully assigned opendatahub/maas-controller-7f9f487f56-qj5rp to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk to ip-10-0-133-91.us-west-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-r2nwh

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-r2nwh to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-8rl4t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-8rl4t to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-sxjs7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-sxjs7 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-7hsfv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-7hsfv to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-58nlg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-58nlg to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-fpmc6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-fpmc6 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-gqbnx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-gqbnx to ip-10-0-133-91.us-west-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-5jzd5

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-5jzd5 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-6d969c5987-wm52k

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6d969c5987-wm52k to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-gz787

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-gz787 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-h2z4h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-h2z4h to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Scheduled

Successfully assigned openshift-ingress/e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-svxzp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-svxzp to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-kg4gz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-kg4gz to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-161111-openshift-default-cf8877bd7-tq97q to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4 to ip-10-0-133-91.us-west-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-h7zm2

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-h7zm2 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b to ip-10-0-141-86.us-west-2.compute.internal

opendatahub

maas-controller-569467969-472sq

Scheduled

Successfully assigned opendatahub/maas-controller-569467969-472sq to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648 to ip-10-0-133-91.us-west-2.compute.internal

opendatahub

odh-model-controller-769875db56-p67bl

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-p67bl to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp to ip-10-0-133-91.us-west-2.compute.internal

kuadrant-system

authorino-57dbf74b78-dx9mj

Scheduled

Successfully assigned kuadrant-system/authorino-57dbf74b78-dx9mj to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd to ip-10-0-137-17.us-west-2.compute.internal

kuadrant-system

authorino-57f7f8659f-wc752

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-wc752 to ip-10-0-137-17.us-west-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-zv2wk

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-zv2wk to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

Scheduled

Successfully assigned openshift-ingress/e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

Scheduled

Successfully assigned openshift-ingress/e2e-ait-63d97fec-openshift-default-65568db4dc-chz78 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z to ip-10-0-137-17.us-west-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-54489f778c-7dqqm

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-54489f778c-7dqqm to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-6d969c5987-s82hb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6d969c5987-s82hb to ip-10-0-133-91.us-west-2.compute.internal

kuadrant-system

authorino-69c469695-qxqk8

Scheduled

Successfully assigned kuadrant-system/authorino-69c469695-qxqk8 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j to ip-10-0-137-17.us-west-2.compute.internal

cert-manager

cert-manager-597b95cb84-k7dzc

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-k7dzc to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k to ip-10-0-141-86.us-west-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-4nlcm

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-4nlcm to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp to ip-10-0-137-17.us-west-2.compute.internal

kuadrant-system

authorino-79dd6cdc8f-pkg5m

Scheduled

Successfully assigned kuadrant-system/authorino-79dd6cdc8f-pkg5m to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8 to ip-10-0-141-86.us-west-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-zdbtw

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-zdbtw to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz to ip-10-0-141-86.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-5h8lq

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-5h8lq to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b to ip-10-0-133-91.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-88frl

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-88frl to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw to ip-10-0-141-86.us-west-2.compute.internal

opendatahub

test-curl-7700-2a919c

Scheduled

Successfully assigned opendatahub/test-curl-7700-2a919c to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

test-curl-7700-43fbd6

Scheduled

Successfully assigned opendatahub/test-curl-7700-43fbd6 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh to ip-10-0-133-91.us-west-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-6c8sn

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-6c8sn to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-ltvq9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-ltvq9 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

test-curl-7700-967a75

Scheduled

Successfully assigned opendatahub/test-curl-7700-967a75 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-rp479

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-rp479 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-wjg9j

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wjg9j to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2qq6c to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd to ip-10-0-141-86.us-west-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-jj7d9

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-jj7d9 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85 to ip-10-0-133-91.us-west-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-pwlj6

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-pwlj6 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-cxp9x

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-cxp9x to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks to ip-10-0-141-86.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-rhmj8

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rhmj8 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

ai-gateway-controller-9ddfdbfbf-zn9hh

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-9ddfdbfbf-zn9hh to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

router-default-5c8c9db44f-llgx4

Scheduled

Successfully assigned openshift-ingress/router-default-5c8c9db44f-llgx4 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0b0026e9-openshift-default-c8b545777-skq67 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7556cf8c57xlwjz

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7556cf8c57xlwjz to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl to ip-10-0-133-91.us-west-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-xrzqj

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-xrzqj to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-x2fbn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-x2fbn to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-zjzp6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zjzp6 to ip-10-0-141-86.us-west-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-bjh6x

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-bjh6x to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l to ip-10-0-137-17.us-west-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-x544p

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-x544p to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv to ip-10-0-137-17.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7d6c4dc889-zjgkt to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5 to ip-10-0-133-91.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7d6c4dc889-w9gzm to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t to ip-10-0-133-91.us-west-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dfrsk

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-dfrsk to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-7d6c4dc889-p5km2 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-wc4d4 to ip-10-0-141-86.us-west-2.compute.internal

opendatahub

test-curl-7706-fc6448

Scheduled

Successfully assigned opendatahub/test-curl-7706-fc6448 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

test-curl-7706-fa1a75

Scheduled

Successfully assigned opendatahub/test-curl-7706-fa1a75 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

test-curl-7706-a386f9

Scheduled

Successfully assigned opendatahub/test-curl-7706-a386f9 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs to ip-10-0-141-86.us-west-2.compute.internal

opendatahub

test-curl-7706-7e4494

Scheduled

Successfully assigned opendatahub/test-curl-7706-7e4494 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-4401bb-9675b947-89hg9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4401bb-9675b947-89hg9 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw to ip-10-0-133-91.us-west-2.compute.internal

opendatahub

test-curl-7706-7865fd

Scheduled

Successfully assigned opendatahub/test-curl-7706-7865fd to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

test-curl-7706-2ecef3

Scheduled

Successfully assigned opendatahub/test-curl-7706-2ecef3 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

router-default-5c8c9db44f-llgx4

FailedScheduling

no nodes available to schedule pods

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j to ip-10-0-133-91.us-west-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-kcnm8

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-kcnm8 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-8cgnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-8cgnk to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-161111-786d9b8465-52bs8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-161111-786d9b8465-52bs8 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-872730-5874968845-brksr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-872730-5874968845-brksr to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs to ip-10-0-141-86.us-west-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-b7l5w

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-b7l5w to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx to ip-10-0-133-91.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-7474dfb69b-gj7th

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7474dfb69b-gj7th to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8 to ip-10-0-133-91.us-west-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-9mgj6

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-9mgj6 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w to ip-10-0-141-86.us-west-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6587ea-openshift-default-549c57899c-xv7qk to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b to ip-10-0-133-91.us-west-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-xr5st

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-xr5st to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw to ip-10-0-141-86.us-west-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln to ip-10-0-141-86.us-west-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

router-default-5c8c9db44f-llgx4

FailedScheduling

no nodes available to schedule pods

openshift-ingress

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-9xpg2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-9xpg2 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq to ip-10-0-133-91.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-6844c89498-9ld8d

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6844c89498-9ld8d to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s to ip-10-0-141-86.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-59fbf69455-5km7v

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-59fbf69455-5km7v to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6f54779779-c77bq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6f54779779-c77bq to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5 to ip-10-0-137-17.us-west-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-9zdg4

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-9zdg4 to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7 to ip-10-0-141-86.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq to ip-10-0-133-91.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-6844c89498-74pp2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6844c89498-74pp2 to ip-10-0-133-91.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n to ip-10-0-137-17.us-west-2.compute.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5c8c9db44f from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-5c8c9db44f

SuccessfulCreate

Created pod: router-default-5c8c9db44f-llgx4
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-5c8c9db44f-llgx4

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-5c8c9db44f-llgx4

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5c8c9db44f-llgx4

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-5c8c9db44f-llgx4

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5c8c9db44f-llgx4

Created

Container created

openshift-ingress

multus

router-default-5c8c9db44f-llgx4

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5c8c9db44f-llgx4

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-5c8c9db44f-llgx4

Started

Container started

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-cxp9x

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-cxp9x

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.676s (4.676s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-fj82z

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-5579cb49c9 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-fj82z

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-5579cb49c9

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-5579cb49c9-wjjph

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.369s (9.369s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.552s (9.552s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-zv2wk
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-zv2wk

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-zv2wk

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-zv2wk

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-zv2wk

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.913s (3.913s including waiting). Image size: 224874686 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-zv2wk

Started

Container started

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-zv2wk_d8b0eb54-2a4f-403e-92d3-e8aaf56897f1 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-6c8sn

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-6c8sn

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-6c8sn

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-6c8sn

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-6c8sn

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-6c8sn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.331s (3.331s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-6c8sn_5798cf3d-94eb-482b-9169-7541cd610667

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-6c8sn_5798cf3d-94eb-482b-9169-7541cd610667 became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-zdbtw

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

authorino-operator-7b7bb4bc77-zdbtw

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-zdbtw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7d6c4dc889

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7d6c4dc889-p5km2

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7d6c4dc889

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-zdbtw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.284s (2.284s including waiting). Image size: 167738465 bytes.

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-7d6c4dc889 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-7d6c4dc889

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-zdbtw

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-zdbtw_c429a65e-f251-4b18-9277-3df4c9affbe2

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-zdbtw_c429a65e-f251-4b18-9277-3df4c9affbe2 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-zdbtw

Created

Container created

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.439s (3.439s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.502s (3.502s including waiting). Image size: 273709574 bytes.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.667s (3.667s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Started

Container started

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-rhmj8

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 843ms (843ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-rhmj8

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rhmj8

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 993ms (993ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 956ms (956ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-p5km2

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Started

Container started

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-7d6c4dc889-zjgkt

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-dfrsk

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-r2nwh

opendatahub-operator-system

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm_4adcecf9-bb7f-438f-ae8c-ffa770db28b3

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-7d6c4dc889-w9gzm_4adcecf9-bb7f-438f-ae8c-ffa770db28b3 became leader

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-r2nwh

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-dfrsk

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-r2nwh

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dfrsk

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-5jzd5
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rhmj8

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5jzd5

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-5jzd5

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rhmj8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.965s (4.965s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-rhmj8

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-rhmj8_1aec055a-b4ea-4c6c-84f6-743ef745c122

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-rhmj8_1aec055a-b4ea-4c6c-84f6-743ef745c122 became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-r2nwh

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dfrsk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 4.475s (4.475s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dfrsk

Started

Container started

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dfrsk_d9457268-2e3b-4cf9-bb77-75132b63ca19

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-dfrsk_d9457268-2e3b-4cf9-bb77-75132b63ca19 became leader

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-r2nwh

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.339s (5.339s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dfrsk

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-r2nwh

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5jzd5

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5jzd5

Created

Container created

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-jj7d9

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-5jzd5

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.999s (3.999s including waiting). Image size: 309650901 bytes.

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-k7dzc

cert-manager

kubelet

cert-manager-597b95cb84-k7dzc

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-597b95cb84-k7dzc

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jj7d9

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-jj7d9

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-k7dzc

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-k7dzc

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-k7dzc

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.938s (3.938s including waiting). Image size: 309650901 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jj7d9

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jj7d9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.805s (5.805s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jj7d9

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7556cf8c57

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7556cf8c57xlwjz

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6d969c5987 from 0 to 2

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7556cf8c57 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-s82hb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-6d969c5987-wm52k

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-6d969c5987

SuccessfulCreate

Created pod: kube-auth-proxy-6d969c5987-wm52k

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-wm52k

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-6d969c5987-s82hb

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-6d969c5987

SuccessfulCreate

Created pod: kube-auth-proxy-6d969c5987-s82hb

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c57xlwjz

Created

Container created

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7556cf8c57xlwjz

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c57xlwjz

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7556cf8c57xlwjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

multus

limitador-limitador-74dfcfb894-xrzqj

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-s82hb

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-wm52k

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-wm52k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.934s (2.934s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xrzqj

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-xrzqj

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-s82hb

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-s82hb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.886s (2.886s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6d969c5987-wm52k

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-wc752

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xrzqj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.083s (2.083s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-wc752

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-wc752

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xrzqj

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xrzqj

Created

Container created

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-h7zm2

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-x544p

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-wc752

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.99s (2.99s including waiting). Image size: 204096810 bytes.

kuadrant-system

multus

authorino-56c6c9ddd5-h7zm2

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-7c9b87d574-x544p

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-wc752

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-h7zm2

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-x544p

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

authorino-57f7f8659f-wc752

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-h7zm2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.763s (2.763s including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-wc752

kuadrant-system

kubelet

authorino-57f7f8659f-wc752

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-h7zm2

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-h7zm2

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-x544p

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-x544p

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.701s (3.701s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-x544p

Created

Container created

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-hl652"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-z6j7l"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-54489f778c

SuccessfulCreate

Created pod: jobset-controller-manager-54489f778c-7dqqm

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-54489f778c from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

kubelet

jobset-controller-manager-54489f778c-7dqqm

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-54489f778c-7dqqm

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-54489f778c-7dqqm

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.768s (3.768s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-54489f778c-7dqqm

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-54489f778c-7dqqm

Created

Container created

openshift-jobset-operator

jobset-controller-manager-54489f778c-7dqqm_4d40f237-9cb7-47c5-b394-0d89c8c1c6ef

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-54489f778c-7dqqm_4d40f237-9cb7-47c5-b394-0d89c8c1c6ef became leader

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-xrzqj

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-xrzqj

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-rp479

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-rp479

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-rp479

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-rp479

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-rp479

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-rp479

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.966s (1.966s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-rp479_1cdfee7c-4e4b-4384-ab7d-0be49f72c361

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-rp479_1cdfee7c-4e4b-4384-ab7d-0be49f72c361 became leader

opendatahub

replicaset-controller

maas-controller-7f9f487f56

SuccessfulCreate

Created pod: maas-controller-7f9f487f56-qj5rp

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7f9f487f56 from 0 to 1

opendatahub

replicaset-controller

maas-controller-569467969

SuccessfulCreate

Created pod: maas-controller-569467969-472sq

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-569467969 from 0 to 1

opendatahub

kubelet

maas-controller-7f9f487f56-qj5rp

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:deb97afee9763c8d5076493274d727f7f8f825da606bc7314ccbaa64aabc19be"

opendatahub

multus

maas-controller-7f9f487f56-qj5rp

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

opendatahub

multus

maas-controller-569467969-472sq

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-569467969-472sq

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:deb97afee9763c8d5076493274d727f7f8f825da606bc7314ccbaa64aabc19be"

opendatahub

kubelet

maas-controller-569467969-472sq

Started

Container started

opendatahub

kubelet

maas-controller-7f9f487f56-qj5rp

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:deb97afee9763c8d5076493274d727f7f8f825da606bc7314ccbaa64aabc19be" in 4.531s (4.531s including waiting). Image size: 200094735 bytes.

opendatahub

kubelet

maas-controller-7f9f487f56-qj5rp

Created

Container created

opendatahub

kubelet

maas-controller-569467969-472sq

Created

Container created

opendatahub

kubelet

maas-controller-569467969-472sq

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:deb97afee9763c8d5076493274d727f7f8f825da606bc7314ccbaa64aabc19be" in 3.978s (3.978s including waiting). Image size: 200094735 bytes.

opendatahub

kubelet

maas-controller-7f9f487f56-qj5rp

Started

Container started

opendatahub

maas-controller-569467969-472sq_7e584241-1b3d-4aa5-b9b2-bf0bd3f65f6a

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-569467969-472sq_7e584241-1b3d-4aa5-b9b2-bf0bd3f65f6a became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

replicaset-controller

maas-controller-7f9f487f56

SuccessfulDelete

Deleted pod: maas-controller-7f9f487f56-qj5rp

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-7f9f487f56 from 1 to 0

opendatahub

kubelet

maas-controller-7f9f487f56-qj5rp

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 12.592s (12.592s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-wc4d4

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-wjg9j

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wjg9j

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wjg9j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wjg9j

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-wjg9j

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wjg9j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wjg9j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-cxp9x

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

Unhealthy

Readiness probe failed: Get "http://10.134.0.20:8080/ready": dial tcp 10.134.0.20:8080: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

ProbeError

Readiness probe error: Get "http://10.134.0.20:8080/ready": dial tcp 10.134.0.20:8080: connect: connection refused body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-cxp9x

Killing

Stopping container discovery

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-5h8lq

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-p67bl

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-pwlj6

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-9zdg4

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

multus

kserve-controller-manager-776cc66d47-pwlj6

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-9zdg4

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

odh-model-controller-769875db56-p67bl

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-p67bl

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-pwlj6

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-5h8lq

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5h8lq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

model-serving-api-75bd89fdfc-9zdg4

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-9zdg4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.291s (2.291s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-pwlj6

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.54s (2.54s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-pwlj6

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-9zdg4

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-9zdg4

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-pwlj6

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5h8lq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.189s (3.189s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5h8lq

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-pwlj6_71ecb6e0-9282-4d99-84de-b42810ad25c8

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-pwlj6_71ecb6e0-9282-4d99-84de-b42810ad25c8 became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5h8lq

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-p67bl

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-p67bl

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-p67bl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.882s (3.882s including waiting). Image size: 236755567 bytes.

opendatahub

llmisvc-controller-manager-869d5dcc5d-5h8lq_e0411a15-ccaf-4d35-b51f-89c98f7d6165

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-5h8lq_e0411a15-ccaf-4d35-b51f-89c98f7d6165 became leader

opendatahub

odh-model-controller-769875db56-p67bl_4cd2999f-60dc-4a9f-a780-4c16263d4665

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-p67bl_4cd2999f-60dc-4a9f-a780-4c16263d4665 became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Created

Container created

kuadrant-system

replicaset-controller

authorino-69c469695

SuccessfulCreate

Created pod: authorino-69c469695-qxqk8
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

multus

authorino-6f6944bcdd-4nlcm

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-4nlcm

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-4nlcm

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-69c469695 from 0 to 1

kuadrant-system

replicaset-controller

authorino-79dd6cdc8f

SuccessfulCreate

Created pod: authorino-79dd6cdc8f-pkg5m

kuadrant-system

replicaset-controller

authorino-69c469695

SuccessfulDelete

Deleted pod: authorino-69c469695-qxqk8

kuadrant-system

kubelet

authorino-79dd6cdc8f-pkg5m

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-79dd6cdc8f from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-69c469695 from 1 to 0

kuadrant-system

kubelet

authorino-6f6944bcdd-4nlcm

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-79dd6cdc8f-pkg5m

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

kuadrant-system

multus

authorino-69c469695-qxqk8

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-69c469695-qxqk8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6f6944bcdd-4nlcm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.663s (1.663s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-4nlcm

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-4nlcm

Created

Container created

kuadrant-system

kubelet

authorino-69c469695-qxqk8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.446s (1.446s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-69c469695-qxqk8

Started

Container started

kuadrant-system

kubelet

authorino-69c469695-qxqk8

Created

Container created

kuadrant-system

kubelet

authorino-69c469695-qxqk8

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6f6944bcdd-4nlcm

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-79dd6cdc8f-pkg5m

Started

Container started

kuadrant-system

kubelet

authorino-79dd6cdc8f-pkg5m

Created

Container created

kuadrant-system

kubelet

authorino-79dd6cdc8f-pkg5m

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.543s (1.543s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-h7zm2

kuadrant-system

kubelet

authorino-56c6c9ddd5-h7zm2

Killing

Stopping container authorino
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

llmisvc-controller-manager-6466c554d8-88frl

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-88frl

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-88frl

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-88frl

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-88frl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 760ms (760ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-88frl

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-5h8lq

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-5h8lq

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-bjh6x

opendatahub

multus

ai-gateway-controller-7d85675f98-bjh6x

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bjh6x

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bjh6x

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bjh6x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 3.299s (3.299s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bjh6x

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-bjh6x_331f0b94-5253-4c3b-8d79-8ff1a2a26703

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-bjh6x_331f0b94-5253-4c3b-8d79-8ff1a2a26703 became leader

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-8cgnk

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-9xpg2
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xpg2

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-9xpg2

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-8cgnk

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-8cgnk

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-8cgnk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.091s (3.091s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xpg2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xpg2

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-8cgnk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-9xpg2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.906s (2.906s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-8cgnk

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-9ddfdbfbf from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-9ddfdbfbf

SuccessfulCreate

Created pod: ai-gateway-controller-9ddfdbfbf-zn9hh

opendatahub

kubelet

ai-gateway-controller-9ddfdbfbf-zn9hh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-9ddfdbfbf-zn9hh

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

llmisvc-controller-manager-6466c554d8-88frl_9e37f938-68f5-40bf-91fd-9770327b8e67

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-88frl_9e37f938-68f5-40bf-91fd-9770327b8e67 became leader

opendatahub

kubelet

ai-gateway-controller-9ddfdbfbf-zn9hh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 907ms (907ms including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-9ddfdbfbf-zn9hh

Started

Container started

opendatahub

kubelet

ai-gateway-controller-9ddfdbfbf-zn9hh

Created

Container created

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-bjh6x

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-bjh6x

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.74s (1.74s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g2jpn

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kcnm8

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-kcnm8

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-kcnm8

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kcnm8

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.554s (1.554s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kcnm8

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-kcnm8

Started

Container started

opendatahub

ai-gateway-controller-9ddfdbfbf-zn9hh_c1ff6623-bff7-46f2-9337-a09535ff3ad6

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-9ddfdbfbf-zn9hh_c1ff6623-bff7-46f2-9337-a09535ff3ad6 became leader

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-b7l5w

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-b7l5w

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-b7l5w

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-b7l5w

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-b7l5w

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 559ms (559ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-b7l5w

Created

Container created

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-9mgj6

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9mgj6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9mgj6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 617ms (617ms including waiting). Image size: 98346788 bytes.

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-9mgj6

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9mgj6

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-9mgj6

Started

Container started

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8s2xqp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 640ms (640ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

multus

echo-simulator-kserve-64b6f8f96c-xr5st

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-xr5st

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xr5st

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xr5st

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.232s (2.232s including waiting). Image size: 78208878 bytes.

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xr5st

Started

Container started

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-xr5st

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-kg4gz

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 610ms (610ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8xstj

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 1 to 2

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-kg4gz

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-kg4gz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 578ms (578ms including waiting). Image size: 98346788 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-kg4gz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.467s (4.467s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-kg4gz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-kg4gz

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-kg4gz

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-kg4gz

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-ltvq9

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-c77bq

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-c77bq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ltvq9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 2 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-ltvq9

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ltvq9

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ltvq9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.526s (4.526s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ltvq9

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ltvq9

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-ltvq9

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:

kuadrant-system

replicaset-controller

authorino-57dbf74b78

SuccessfulCreate

Created pod: authorino-57dbf74b78-dx9mj

kuadrant-system

kubelet

authorino-57dbf74b78-dx9mj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57dbf74b78-dx9mj

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-gqbnx

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 4 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-gqbnx

kuadrant-system

kubelet

authorino-57dbf74b78-dx9mj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

replicaset-controller

authorino-79dd6cdc8f

SuccessfulDelete

Deleted pod: authorino-79dd6cdc8f-pkg5m

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

Created

Container created
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-79dd6cdc8f from 1 to 0

kuadrant-system

kubelet

authorino-57dbf74b78-dx9mj

Started

Container started

kuadrant-system

kubelet

authorino-57dbf74b78-dx9mj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.731s (1.731s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-79dd6cdc8f-pkg5m

Killing

Stopping container authorino

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-63d97fec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-63d97fec

openshift-ingress

replicaset-controller

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f

SuccessfulCreate

Created pod: e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

openshift-ingress

deployment-controller

e2e-ait-2a41d4db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2a41d4db-openshift-default-5dd47c8b4f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-2a41d4db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2a41d4db

openshift-ingress

gateway_labeler_controller

e2e-migrate-4b2e37ae-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4b2e37ae-gw

openshift-ingress

replicaset-controller

e2e-ait-63d97fec-openshift-default-65568db4dc

SuccessfulCreate

Created pod: e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

openshift-ingress

multus

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-63d97fec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-63d97fec-openshift-default-65568db4dc from 0 to 1

openshift-ingress

multus

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-4b2e37ae-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf

SuccessfulCreate

Created pod: e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

openshift-ingress

multus

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-0b0026e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0b0026e9

openshift-ingress

replicaset-controller

e2e-ait-0b0026e9-openshift-default-c8b545777

SuccessfulCreate

Created pod: e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

openshift-ingress

deployment-controller

e2e-ait-0b0026e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0b0026e9-openshift-default-c8b545777 from 0 to 1

openshift-ingress

multus

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2a41d4db-564597649f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2a41d4db-564597649f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2a41d4db-564597649f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2a41d4db: serviceaccount "payload-processing-e2e-ait-2a41d4db" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2a41d4db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2a41d4db-564597649f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-4705e99c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-4705e99c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2a41d4db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2a41d4db: serviceaccount "payload-processing-e2e-ait-2a41d4db" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt

openshift-ingress

deployment-controller

e2e-derive-4705e99c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-4705e99c-openshift-default-54c9fb7bb5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-4705e99c-openshift-default-54c9fb7bb5

SuccessfulCreate

Created pod: e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

openshift-ingress

kubelet

payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4b2e37ae: serviceaccount "payload-processing-e2e-migrate-4b2e37ae" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4b2e37ae-b99c48959

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4b2e37ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4b2e37ae-b99c48959 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4b2e37ae-b99c48959

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4b2e37ae-b99c48959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4b2e37ae: serviceaccount "payload-processing-e2e-migrate-4b2e37ae" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4b2e37ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv

openshift-ingress

multus

payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-63d97fec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-63d97fec-55b7b8d65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-63d97fec-55b7b8d65

SuccessfulCreate

Created pod: payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-63d97fec: serviceaccount "payload-processing-e2e-ait-63d97fec" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-63d97fec-55b7b8d65

FailedCreate

Error creating: pods "payload-processing-e2e-ait-63d97fec-55b7b8d65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-63d97fec: serviceaccount "payload-processing-e2e-ait-63d97fec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-63d97fec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0b0026e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0b0026e9: serviceaccount "payload-processing-e2e-ait-0b0026e9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0b0026e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0b0026e9-547c9d965f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0b0026e9-547c9d965f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0b0026e9-547c9d965f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0b0026e9: serviceaccount "payload-processing-e2e-ait-0b0026e9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0b0026e9-547c9d965f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0b0026e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0b0026e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-4705e99c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-4705e99c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-4705e99c-6b46b75947 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4705e99c-6b46b75947

SuccessfulCreate

Created pod: payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4705e99c: serviceaccount "payload-processing-e2e-derive-4705e99c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4705e99c-6b46b75947

FailedCreate

Error creating: pods "payload-processing-e2e-derive-4705e99c-6b46b75947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4705e99c: serviceaccount "payload-processing-e2e-derive-4705e99c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.442s (3.442s including waiting). Image size: 125353965 bytes.
(x2)

openshift-ingress

kubelet

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4705e99c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4705e99c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-63d97fec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-63d97fec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-63d97fec-6c64cd86f5-l8zw7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-63d97fec-55b7b8d65-bsp56

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-63d97fec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-63d97fec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2a41d4db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-4b2e37ae-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2a41d4db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-4b2e37ae-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0b0026e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-0b0026e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0b0026e9-68f444d9bc-tdp8d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0b0026e9-547c9d965f-w9fzc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-63d97fec-openshift-default-65568db4dc-chz78

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-7f66ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-7f66ab

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4b2e37ae-57684d7fcf-fqssv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4b2e37ae-b99c48959-27bkf

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-4b2e37ae-gw-openshift-default-b4b4489bf-vmtx9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2a41d4db-85d5d4dcff-8ttbt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2a41d4db-564597649f-cb7sj

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-d09fff-openshift-default-86957cb9c9

SuccessfulCreate

Created pod: e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

openshift-ingress

deployment-controller

e2e-worker-w0-d09fff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d09fff-openshift-default-86957cb9c9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-d09fff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-d09fff

openshift-ingress

kubelet

e2e-ait-0b0026e9-openshift-default-c8b545777-skq67

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-b47e8d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-b47e8d

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

openshift-ingress

multus

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 0 to 1

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2a41d4db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2a41d4db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-7f66ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-7f66ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-7f66ab: serviceaccount "payload-processing-e2e-worker-w2-7f66ab" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-7f66ab: serviceaccount "payload-processing-e2e-worker-w2-7f66ab" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-b47e8d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-b47e8d-555f77c5b5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b47e8d: serviceaccount "payload-processing-e2e-worker-w3-b47e8d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-b47e8d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b47e8d: serviceaccount "payload-processing-e2e-worker-w3-b47e8d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

openshift-ingress

multus

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-d09fff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-d09fff-7bfdd689b5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-d09fff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d09fff: serviceaccount "payload-processing-e2e-worker-w0-d09fff" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d09fff: serviceaccount "payload-processing-e2e-worker-w0-d09fff" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-4705e99c-6b46b75947-sll7q

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4705e99c-7bfd5b8455-4z52n

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d09fff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d09fff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-e524ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-e524ce

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-2a41d4db-openshift-default-5dd47c8b4f-bwh6z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4705e99c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-4705e99c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-e524ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-e524ce-7f6847f7bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-e524ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-e524ce-566b866699 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e524ce: serviceaccount "payload-processing-e2e-worker-w4-e524ce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e524ce-566b866699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

openshift-ingress

multus

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e524ce-566b866699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-e524ce-566b866699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e524ce: serviceaccount "payload-processing-e2e-worker-w4-e524ce" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd

Started

Container started

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-e65019

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-e65019

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-4705e99c-openshift-default-54c9fb7bb5-ghn7q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-e65019-789f4df9d5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-e65019-789f4df9d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e65019: serviceaccount "payload-processing-e2e-worker-w1-e65019" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-e65019: serviceaccount "payload-processing-e2e-worker-w1-e65019" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-e65019

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-e65019-789f4df9d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-e65019

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-e65019-789f4df9d5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 1 to 4

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

Started

Container started

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Started

Container started

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d09fff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d09fff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": read tcp 10.132.0.2:57196->10.132.0.72:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": read tcp 10.132.0.2:57196->10.132.0.72:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 5; reason:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-kg4gz

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-kg4gz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 1 to 2

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5ff46798db from 0 to 1
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-5ff46798db

FailedCreate

Error creating: pods "payload-processing-external-model-5ff46798db-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

multus

payload-processing-external-model-5ff46798db-xzrpd

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-5ff46798db

SuccessfulCreate

Created pod: payload-processing-external-model-5ff46798db-xzrpd

models-as-a-service

kubelet

payload-processing-external-model-5ff46798db-xzrpd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5ff46798db-xzrpd

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5ff46798db-xzrpd

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Created

Container created

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Created

Container created

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-fpmc6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-8rl4t

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-zjzp6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-h2z4h

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-h2z4h

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-zjzp6

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-8rl4t

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-fpmc6

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-7474dfb69b

SuccessfulCreate

Created pod: payload-processing-external-model-7474dfb69b-gj7th

models-as-a-service

multus

payload-processing-external-model-7474dfb69b-gj7th

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7474dfb69b from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-7474dfb69b-gj7th

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-7474dfb69b-gj7th

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-7474dfb69b-gj7th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6f54779779-x2fbn

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-x2fbn

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 8 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-58nlg

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 5 to 7

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

Started

Container started

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

Created

Container created
(x4)

models-as-a-service

kubelet

payload-processing-external-model-5ff46798db-xzrpd

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-4c4542dd9101" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x7)

models-as-a-service

kubelet

payload-processing-external-model-7474dfb69b-gj7th

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7474dfb69b from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-6844c89498

SuccessfulCreate

Created pod: payload-processing-external-model-6844c89498-9ld8d

models-as-a-service

replicaset-controller

payload-processing-external-model-7474dfb69b

SuccessfulDelete

Deleted pod: payload-processing-external-model-7474dfb69b-gj7th

models-as-a-service

kubelet

payload-processing-external-model-7474dfb69b-gj7th

Killing

Stopping container payload-processing

models-as-a-service

multus

payload-processing-external-model-6844c89498-9ld8d

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-9ld8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-9ld8d

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-9ld8d

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 4 to 7

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

Started

Container started

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

Started

Container started

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

Started

Container started

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

models-as-a-service

kubelet

payload-processing-external-model-5ff46798db-xzrpd

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-594b013fa537" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-59fbf69455

SuccessfulCreate

Created pod: payload-processing-external-model-59fbf69455-5km7v
(x10)

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-9ld8d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-9ld8d

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-59fbf69455 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6844c89498

SuccessfulDelete

Deleted pod: payload-processing-external-model-6844c89498-9ld8d

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6844c89498 from 1 to 0

models-as-a-service

multus

payload-processing-external-model-59fbf69455-5km7v

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-59fbf69455-5km7v

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-59fbf69455-5km7v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-59fbf69455-5km7v

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Unhealthy

Readiness probe failed: Get "https://10.132.0.57:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-5ff46798db

SuccessfulDelete

Deleted pod: payload-processing-external-model-5ff46798db-xzrpd

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5ff46798db from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-5ff46798db-xzrpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulCreate

Created pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 7 to 10

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-d09fff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d09fff-openshift-default-86957cb9c9 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d09fff-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-d09fff-openshift-default-86957cb9c9

SuccessfulCreate

Created pod: e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

openshift-ingress

replicaset-controller

e2e-worker-w0-d09fff-openshift-default-86957cb9c9

SuccessfulCreate

Created pod: e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6844c89498 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Started

Container started

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

Started

Container started

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-6844c89498

SuccessfulCreate

Created pod: payload-processing-external-model-6844c89498-74pp2
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-74pp2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-74pp2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6844c89498-74pp2

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-74pp2

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Unhealthy

Readiness probe failed: Get "https://10.132.0.57:8000/ready": context deadline exceeded

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-74pp2

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-59fbf69455-5km7v

Killing

Stopping container payload-processing
(x2)

models-as-a-service

kubelet

payload-processing-external-model-6844c89498-74pp2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 6 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-mt-4cf21208

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4cf21208

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

openshift-ingress

deployment-controller

e2e-mt-4cf21208-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4cf21208-openshift-default-6b4f6cc45c from 0 to 1

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-d5e5df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d5e5df

openshift-ingress

deployment-controller

e2e-api-a-d5e5df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d5e5df-openshift-default-7c66456d47 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-d5e5df-openshift-default-7c66456d47

SuccessfulCreate

Created pod: e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

openshift-ingress

multus

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4cf21208: serviceaccount "payload-processing-e2e-mt-4cf21208" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4cf21208-867cd99b5f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4cf21208-867cd99b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4cf21208: serviceaccount "payload-processing-e2e-mt-4cf21208" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4cf21208

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4cf21208-8455c87ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4cf21208

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4cf21208-867cd99b5f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4cf21208-867cd99b5f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

openshift-ingress

multus

payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d5e5df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d5e5df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d5e5df-b849489b9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d5e5df-b849489b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d5e5df-b849489b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d5e5df: serviceaccount "payload-processing-e2e-api-a-d5e5df" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d5e5df-b849489b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d5e5df: serviceaccount "payload-processing-e2e-api-a-d5e5df" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

ProbeError

Readiness probe error: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-2qq6c

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 9.202s (9.202s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

Created

Container created
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

Started

Container started

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-ptdwm
(x2)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4cf21208-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4cf21208-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d5e5df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d5e5df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-dbe0a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-dbe0a7

openshift-ingress

deployment-controller

e2e-api-b-dbe0a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-dbe0a7-openshift-default-668db66569 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-dbe0a7-openshift-default-668db66569

SuccessfulCreate

Created pod: e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

openshift-ingress

multus

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-dbe0a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-dbe0a7-6798b9b4f5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-dbe0a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dbe0a7: serviceaccount "payload-processing-e2e-api-b-dbe0a7" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dbe0a7: serviceaccount "payload-processing-e2e-api-b-dbe0a7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2

Created

Container created
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 2 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4cf21208-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4cf21208-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d5e5df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d5e5df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-a-872730-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-872730-openshift-default-666b77ccc9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-872730

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-872730

openshift-ingress

replicaset-controller

e2e-api-a-872730-openshift-default-666b77ccc9

SuccessfulCreate

Created pod: e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

openshift-ingress

multus

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-872730-5874968845

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-872730-5874968845-brksr

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-872730

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-872730-5874968845 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-872730-6dd75c954c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-872730-5874968845

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-872730-5874968845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-872730: serviceaccount "payload-processing-e2e-api-a-872730" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-872730-6dd75c954c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-872730-6dd75c954c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-872730: serviceaccount "payload-processing-e2e-api-a-872730" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-872730

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-872730-6dd75c954c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-872730-5874968845-brksr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-872730-5874968845-brksr

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-872730-5874968845-brksr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-872730-5874968845-brksr

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-872730-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-872730-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-a-161111-openshift-default-cf8877bd7

SuccessfulCreate

Created pod: e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

openshift-ingress

gateway_labeler_controller

e2e-api-a-161111

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-161111

openshift-ingress

deployment-controller

e2e-api-a-161111-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-161111-openshift-default-cf8877bd7 from 0 to 1

openshift-ingress

multus

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Unhealthy

Readiness probe failed: Get "http://10.133.0.118:15021/healthz/ready": read tcp 10.133.0.2:57380->10.133.0.118:15021: read: connection reset by peer
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-161111-5cf6885b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-161111-5cf6885b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-161111: serviceaccount "payload-processing-e2e-api-a-161111" not found
(x2)

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-161111

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-161111-786d9b8465 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-161111

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-161111-5cf6885b99 from 0 to 1

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

ProbeError

Readiness probe error: Get "http://10.133.0.118:15021/healthz/ready": read tcp 10.133.0.2:57380->10.133.0.118:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-161111-786d9b8465

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-161111-786d9b8465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-161111: serviceaccount "payload-processing-e2e-api-a-161111" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-161111-786d9b8465-52bs8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-161111-786d9b8465-52bs8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-161111-5cf6885b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd

openshift-ingress

multus

payload-processing-e2e-api-a-161111-786d9b8465-52bs8

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-161111-786d9b8465

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-161111-786d9b8465-52bs8

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-161111-786d9b8465-52bs8

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 3 to 5

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-dbe0a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-dbe0a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5e5df-b849489b9-fcxbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5e5df-6f9dccc475-rnnxm

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-872730-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-872730-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-b-4401bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4401bb

openshift-ingress

deployment-controller

e2e-api-b-4401bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4401bb-openshift-default-57d6f47c85 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4401bb-openshift-default-57d6f47c85

SuccessfulCreate

Created pod: e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

openshift-ingress

multus

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": read tcp 10.134.0.2:37450->10.134.0.76:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": read tcp 10.134.0.2:37450->10.134.0.76:15021: read: connection reset by peer

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4401bb-9675b947

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4401bb-9675b947-89hg9
(x2)

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4401bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4401bb-9675b947 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4401bb-5d65df5747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4401bb-5d65df5747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4401bb: serviceaccount "payload-processing-e2e-api-b-4401bb" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4401bb-9675b947

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4401bb-9675b947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4401bb: serviceaccount "payload-processing-e2e-api-b-4401bb" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4401bb-5d65df5747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4401bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4401bb-5d65df5747 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-4401bb-9675b947-89hg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-4401bb-9675b947-89hg9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-4401bb-9675b947-89hg9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-4401bb-9675b947-89hg9

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

opendatahub

multus

test-curl-7700-43fbd6

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7700-43fbd6

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x5)

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7700-43fbd6

Created

Container created

opendatahub

kubelet

test-curl-7700-43fbd6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

opendatahub

kubelet

test-curl-7700-43fbd6

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.31s (1.31s including waiting). Image size: 106100986 bytes.

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4401bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4401bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7700-43fbd6

Killing

Stopping container test-curl-7700-43fbd6

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-161111-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-161111-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-427d70

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-427d70

openshift-ingress

deployment-controller

e2e-api-b-427d70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-427d70-openshift-default-5b4c55bfcf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-427d70-openshift-default-5b4c55bfcf

SuccessfulCreate

Created pod: e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

openshift-ingress

multus

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-d5e5df-openshift-default-7c66456d47-b85lk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-d8wlm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-87rp6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-427d70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-427d70-544c944bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-427d70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-427d70-5f6f8598f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-427d70-544c944bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-427d70-544c944bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-427d70: serviceaccount "payload-processing-e2e-api-b-427d70" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-427d70-544c944bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-427d70-5f6f8598f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-427d70-5f6f8598f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-427d70: serviceaccount "payload-processing-e2e-api-b-427d70" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-427d70-5f6f8598f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf

openshift-ingress

kubelet

payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-161111-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-161111-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbe0a7-6798b9b4f5-5cjf2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbe0a7-5ccb8dbc47-gwcdl

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-d09fff-openshift-default-86957cb9c9

SuccessfulDelete

Deleted pod: e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

openshift-ingress

deployment-controller

e2e-worker-w0-d09fff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-d09fff-openshift-default-86957cb9c9 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-qkjcd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d09fff-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-ipp-a-04d404-openshift-default-5f687b48cf

SuccessfulCreate

Created pod: e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

openshift-ingress

deployment-controller

e2e-ipp-a-04d404-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-04d404-openshift-default-5f687b48cf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-04d404

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-04d404

openshift-ingress

multus

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-04d404

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-04d404-7c76b54d77 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-04d404

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04d404: serviceaccount "payload-processing-e2e-ipp-a-04d404" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04d404-7c76b54d77

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-04d404-7c76b54d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04d404: serviceaccount "payload-processing-e2e-ipp-a-04d404" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04d404-7c76b54d77

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

ProbeError

Startup probe error: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

Unhealthy

Startup probe failed: Get "http://10.133.0.127:15021/healthz/ready": dial tcp 10.133.0.127:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4401bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4401bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-k8r6n

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-fl2qv

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-xtwf5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gq4r5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-tgsmp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-872730-6dd75c954c-9zvdv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-872730-5874968845-brksr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l472n

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-2xklp

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-4qr6p

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ndpw7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 10 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-sw9jc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-27pfc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-njz58

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-vfbxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-q6zpd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-x5qph

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4cf21208: serviceaccount "payload-processing-e2e-mt-4cf21208" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 6 to 4
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4cf21208-867cd99b5f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4cf21208-867cd99b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4cf21208: serviceaccount "payload-processing-e2e-mt-4cf21208" not found

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4cf21208

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4cf21208-867cd99b5f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4cf21208-867cd99b5f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-b8hzp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4cf21208

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4cf21208-8455c87ff9 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-dtsz8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-161111-786d9b8465-52bs8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-161111-5cf6885b99-b2bcd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ad7da0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ad7da0

openshift-ingress

replicaset-controller

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69

SuccessfulCreate

Created pod: e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

openshift-ingress

deployment-controller

e2e-ipp-a-ad7da0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-dbe0a7-openshift-default-668db66569-ht9t5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-427d70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-427d70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ad7da0-7455d77d87

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ad7da0: serviceaccount "payload-processing-e2e-ipp-a-ad7da0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ad7da0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ad7da0-7455d77d87 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ad7da0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ad7da0-7455d77d87

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ad7da0-7455d77d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ad7da0: serviceaccount "payload-processing-e2e-ipp-a-ad7da0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-04d404-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-04d404-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-5f8467dd95-cmncf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-7c76b54d77-6jq8w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-872730-openshift-default-666b77ccc9-b2f2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4401bb-5d65df5747-5spv8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4401bb-9675b947-89hg9

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4cf21208-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-4cf21208-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4cf21208-openshift-default-6b4f6cc45c from 1 to 4

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

Created

Container created

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

Started

Container started

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

Created

Container created

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

Created

Container created

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

Started

Container started

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-04d404

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-04d404

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-04d404-6f79487fbb from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04d404-6f79487fbb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-04d404-6f79487fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04d404: serviceaccount "payload-processing-e2e-ipp-a-04d404" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-04d404: serviceaccount "payload-processing-e2e-ipp-a-04d404" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-04d404-6f79487fbb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

Unhealthy

Startup probe failed: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

ProbeError

Startup probe error: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.899s (1.899s including waiting). Image size: 166612641 bytes.
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.399s (3.399s including waiting). Image size: 166612641 bytes.
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

Unhealthy

Startup probe failed: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

ProbeError

Startup probe error: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

openshift-ingress

deployment-controller

e2e-mt-4cf21208-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4cf21208-openshift-default-6b4f6cc45c from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4cf21208-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

Created

Container created

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

Created

Container created

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

Created

Container created

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

Started

Container started

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

Started

Container started

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

Started

Container started

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

Started

Container started

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

Created

Container created

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 5 to 3

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-6w4sf

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-rbjqc

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8b4b54

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8b4b54

opendatahub

multus

test-curl-7700-967a75

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-8b4b54-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8b4b54-openshift-default-844b4bc955 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-8b4b54-openshift-default-844b4bc955

SuccessfulCreate

Created pod: e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps
(x6)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7700-967a75

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

multus

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7700-967a75

Created

Container created

opendatahub

kubelet

test-curl-7700-967a75

Started

Container started

opendatahub

kubelet

test-curl-7700-967a75

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.098s (3.098s including waiting). Image size: 106100986 bytes.
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

Started

Container started

opendatahub

kubelet

test-curl-7700-967a75

Killing

Stopping container test-curl-7700-967a75

openshift-ingress

kubelet

e2e-api-a-161111-openshift-default-cf8877bd7-tq97q

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-4cf21208-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4cf21208-openshift-default-6b4f6cc45c from 8 to 9

openshift-ingress

replicaset-controller

e2e-mt-4cf21208-openshift-default-6b4f6cc45c

SuccessfulCreate

Created pod: e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ad7da0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ad7da0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4cf21208-openshift-default

SuccessfulRescale

New size: 9; reason:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b4b54: serviceaccount "payload-processing-e2e-ipp-b-8b4b54" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

openshift-ingress

multus

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b4b54-86c94b4997

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8b4b54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c from 0 to 1

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8b4b54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8b4b54-86c94b4997 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b4b54-86c94b4997

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8b4b54-86c94b4997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b4b54: serviceaccount "payload-processing-e2e-ipp-b-8b4b54" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4cf21208-8455c87ff9-627fh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4cf21208-867cd99b5f-dp655

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-427d70-5f6f8598f-td4cf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-427d70-544c944bc-b7qnk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-9dpsd

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-7455d77d87-tqp9q

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-4576d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-4576d9

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-949bddf7f-b9648

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-4576d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-4576d9-openshift-default-dbcdcf94c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c

SuccessfulCreate

Created pod: e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ad7da0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ad7da0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4576d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4576d9-647f75745 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4576d9: serviceaccount "payload-processing-e2e-ipp-b-4576d9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4576d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4576d9-647f75745

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4576d9-647f75745-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4576d9: serviceaccount "payload-processing-e2e-ipp-b-4576d9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4576d9-647f75745

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt

Created

Container created

openshift-ingress

kubelet

e2e-api-b-4401bb-openshift-default-57d6f47c85-8vqcx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-8daffd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c

SuccessfulCreate

Created pod: e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8daffd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8daffd

openshift-ingress

multus

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8daffd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8daffd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8daffd-684b984799 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8daffd-684b984799

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8daffd-684b984799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8daffd: serviceaccount "payload-processing-e2e-ipp-a-8daffd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8daffd-684b984799

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8daffd: serviceaccount "payload-processing-e2e-ipp-a-8daffd" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ad7da0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ad7da0-6c9cf96876 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ad7da0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8

Started

Container started
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ad7da0: serviceaccount "payload-processing-e2e-ipp-a-ad7da0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ad7da0: serviceaccount "payload-processing-e2e-ipp-a-ad7da0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

ProbeError

Readiness probe error: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

Unhealthy

Readiness probe failed: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qr79h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-cft8t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-mzqb9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-75d85

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-s2r74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-qtbrc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-x4dn2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-8zfgj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4cf21208-openshift-default-6b4f6cc45c-89bbp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8daffd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8daffd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b4b54-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b4b54-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 5 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-7xbfs

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-8dgjn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

openshift-ingress

kubelet

e2e-api-b-427d70-openshift-default-5b4c55bfcf-sw7lw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-666c85768c-5gprm

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.150:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-86c94b4997-ckdpw

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.151:50052" within 1s: context deadline exceeded
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0e90fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0e90fe

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97

SuccessfulCreate

Created pod: e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

openshift-ingress

deployment-controller

e2e-ipp-a-0e90fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0e90fe-openshift-default-5d495cbd97 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-rbfck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wvgzs

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4576d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4576d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0e90fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0e90fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0e90fe: serviceaccount "payload-processing-e2e-ipp-a-0e90fe" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0e90fe: serviceaccount "payload-processing-e2e-ipp-a-0e90fe" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-0e90fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-0e90fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 10 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-zjzp6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-fj82z

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-fpmc6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-c77bq

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-x2fbn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-c77bq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fj82z

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4576d9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-4576d9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-x2fbn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-zjzp6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-fpmc6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-svxzp

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-7hsfv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-sxjs7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6f54779779 from 5 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-f84b2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6f54779779-gz787

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-7hsfv

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-gz787

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-svxzp

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-sxjs7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-sxjs7

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6f54779779-f84b2

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-sxjs7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-sxjs7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-5b9645df5f-24vkp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-647f75745-kbnpt

Killing

Stopping container payload-processing

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Unhealthy

Liveness probe failed: Get "https://10.132.0.57:8000/health": context deadline exceeded

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-l4cr5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 3 to 2
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-sxjs7

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-sxjs7

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8b4b54

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8b4b54

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b4b54: serviceaccount "payload-processing-e2e-ipp-b-8b4b54" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b4b54: serviceaccount "payload-processing-e2e-ipp-b-8b4b54" not found

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-mz2vk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

ProbeError

Readiness probe error: Get "http://10.133.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Unhealthy

Readiness probe failed: Get "http://10.133.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Unhealthy

Startup probe failed: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

ProbeError

Startup probe error: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ad7da0-6c9cf96876-5zclr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ad7da0-5d89dfb87-dkvnw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-04d404-7d8b8778bc-ddrlz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-04d404-6f79487fbb-s2cq5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-6486bf56c-f6pn8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-b-7350bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7350bc-openshift-default-5947478dcc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-684b984799-pq72z

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7350bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7350bc

openshift-ingress

replicaset-controller

e2e-ipp-b-7350bc-openshift-default-5947478dcc

SuccessfulCreate

Created pod: e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

openshift-ingress

multus

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

AddedInterface

Add eth0 [10.133.0.163/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-4576d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-4576d9-8658685c87 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-4576d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-4576d9-5d7b588954 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4576d9-5d7b588954

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-4576d9-5d7b588954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4576d9: serviceaccount "payload-processing-e2e-ipp-b-4576d9" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-4576d9: serviceaccount "payload-processing-e2e-ipp-b-4576d9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-4576d9-5d7b588954

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-ad7da0-openshift-default-85bcfdbc69-gbn9g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7350bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7350bc-7794bfff7f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7350bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7350bc-7467486df5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7350bc-7794bfff7f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7350bc-7794bfff7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7350bc: serviceaccount "payload-processing-e2e-ipp-b-7350bc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl

openshift-ingress

kubelet

e2e-ipp-a-04d404-openshift-default-5f687b48cf-7vxds

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7350bc-7794bfff7f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7350bc: serviceaccount "payload-processing-e2e-ipp-b-7350bc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Unhealthy

Readiness probe failed: Get "http://10.133.0.159:15021/healthz/ready": read tcp 10.133.0.2:57492->10.133.0.159:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

ProbeError

Readiness probe error: Get "http://10.133.0.159:15021/healthz/ready": read tcp 10.133.0.2:57492->10.133.0.159:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8daffd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8daffd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-0e90fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-0e90fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-5fbb94d8bc-5tmbx

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6a3357

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6a3357

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-5c6c4d9c5-q979t

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-b-6a3357-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6a3357-openshift-default-664b5474c9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-6a3357-openshift-default-664b5474c9

SuccessfulCreate

Created pod: e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

openshift-ingress

multus

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8daffd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8daffd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8daffd-8b48d74d4 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8daffd: serviceaccount "payload-processing-e2e-ipp-a-8daffd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8daffd-8b48d74d4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8daffd-8b48d74d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8daffd: serviceaccount "payload-processing-e2e-ipp-a-8daffd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8daffd-8b48d74d4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-4576d9-5d7b588954-q5f9t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-4576d9-8658685c87-s8k7b

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a3357-6f547cbd69

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a3357-6f547cbd69

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6a3357-6f547cbd69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a3357: serviceaccount "payload-processing-e2e-ipp-b-6a3357" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6a3357

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a3357: serviceaccount "payload-processing-e2e-ipp-b-6a3357" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6a3357

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6a3357-6f547cbd69 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-4576d9-openshift-default-dbcdcf94c-5b94t

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3bd7fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3bd7fe

openshift-ingress

deployment-controller

e2e-praxis-a-3bd7fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3bd7fe-openshift-default-64596c8d97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97

SuccessfulCreate

Created pod: e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

openshift-ingress

multus

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b4b54-5b69d6b5fd-r2xjx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b4b54-58764b79f5-m56jv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3bd7fe: serviceaccount "payload-processing-e2e-praxis-a-3bd7fe" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3bd7fe: serviceaccount "payload-processing-e2e-praxis-a-3bd7fe" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3bd7fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3bd7fe-8468ff4697 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3bd7fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-8b4b54-openshift-default-844b4bc955-4d6ps

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-40fb42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-40fb42-openshift-default-6858979c77 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-40fb42

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-40fb42

openshift-ingress

replicaset-controller

e2e-praxis-a-40fb42-openshift-default-6858979c77

SuccessfulCreate

Created pod: e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

openshift-ingress

multus

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-40fb42

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-40fb42-77fcf46b47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-40fb42

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0e90fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0e90fe-75596d59bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-40fb42-77fcf46b47

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-40fb42: serviceaccount "payload-processing-e2e-praxis-a-40fb42" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-40fb42-77fcf46b47

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-40fb42-77fcf46b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-40fb42: serviceaccount "payload-processing-e2e-praxis-a-40fb42" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0e90fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss

Created

Container created
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0e90fe-75596d59bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0e90fe-75596d59bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0e90fe: serviceaccount "payload-processing-e2e-ipp-a-0e90fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0e90fe-75596d59bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0e90fe: serviceaccount "payload-processing-e2e-ipp-a-0e90fe" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-872f4a-openshift-default-c5f469f79

SuccessfulCreate

Created pod: e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-872f4a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-872f4a

openshift-ingress

deployment-controller

e2e-ipp-a-872f4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-872f4a-openshift-default-c5f469f79 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-40fb42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-40fb42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-872f4a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-872f4a-69db496db9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-872f4a-69db496db9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-872f4a-69db496db9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-872f4a: serviceaccount "payload-processing-e2e-ipp-a-872f4a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-872f4a-69db496db9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-872f4a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-872f4a: serviceaccount "payload-processing-e2e-ipp-a-872f4a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-7467486df5-6nvkl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-7794bfff7f-zdzqv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

Unhealthy

Startup probe failed: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

ProbeError

Startup probe error: Get "http://10.133.0.163:15021/healthz/ready": dial tcp 10.133.0.163:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a3357-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a3357-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7350bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7350bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a3357-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-6a3357-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7350bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7350bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8daffd-7b886cf7d7-tmr2l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8daffd-8b48d74d4-wvtwj

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3bd7fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3bd7fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7350bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7350bc-6cbcc5665b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7350bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-6f547cbd69-g654t

Killing

Stopping container payload-processing
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7350bc: serviceaccount "payload-processing-e2e-ipp-b-7350bc" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7350bc: serviceaccount "payload-processing-e2e-ipp-b-7350bc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-668f4f8d7-vwqtr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-8daffd-openshift-default-68ffdbcf7c-88lkn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3bd7fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3bd7fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ebcc6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ebcc6d

openshift-ingress

deployment-controller

e2e-praxis-b-ebcc6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ebcc6d-openshift-default-58cb964577 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-ebcc6d-openshift-default-58cb964577

SuccessfulCreate

Created pod: e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

openshift-ingress

multus

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-40fb42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-v6c58

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-40fb42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ebcc6d: serviceaccount "payload-processing-e2e-praxis-b-ebcc6d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ebcc6d-787f588799

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ebcc6d-787f588799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ebcc6d: serviceaccount "payload-processing-e2e-praxis-b-ebcc6d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ebcc6d-787f588799

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ebcc6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ebcc6d-787f588799 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ebcc6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

Unhealthy

Readiness probe failed: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

ProbeError

Readiness probe error: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

ProbeError

Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

Unhealthy

Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-923d78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-923d78

openshift-ingress

multus

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-923d78-openshift-default-b68d59d6f

SuccessfulCreate

Created pod: e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

openshift-ingress

deployment-controller

e2e-praxis-b-923d78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-923d78-openshift-default-b68d59d6f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-872f4a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-872f4a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-923d78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-923d78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-923d78-5cdf899975 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6a3357

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6a3357-5685c57f46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-923d78-5cdf899975

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-923d78-5cdf899975

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-923d78-5cdf899975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-923d78: serviceaccount "payload-processing-e2e-praxis-b-923d78" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-923d78: serviceaccount "payload-processing-e2e-praxis-b-923d78" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6a3357

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a3357-5685c57f46

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6a3357-5685c57f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a3357: serviceaccount "payload-processing-e2e-ipp-b-6a3357" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6a3357: serviceaccount "payload-processing-e2e-ipp-b-6a3357" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6a3357-5685c57f46

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7350bc-6cbcc5665b-2ghgq

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7350bc-66dd4b5799-bt65j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-872f4a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-872f4a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-7350bc-openshift-default-5947478dcc-nh5mw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-ae8879-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ae8879-openshift-default-5bc8464785 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-ae8879-openshift-default-5bc8464785

SuccessfulCreate

Created pod: e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ae8879

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ae8879

openshift-ingress

multus

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-69db496db9-9xcfq

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-b849bfd67-4nwrc

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c89e47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c89e47

openshift-ingress

deployment-controller

e2e-ipp-b-c89e47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c89e47-openshift-default-75d6698785 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c89e47-openshift-default-75d6698785

SuccessfulCreate

Created pod: e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ae8879

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ae8879-594df77f75

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ae8879-594df77f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ae8879: serviceaccount "payload-processing-e2e-praxis-a-ae8879" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ae8879-594df77f75

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ae8879

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ae8879-594df77f75 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ae8879: serviceaccount "payload-processing-e2e-praxis-a-ae8879" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c89e47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c89e47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c89e47-865cb6cd4c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c89e47: serviceaccount "payload-processing-e2e-ipp-b-c89e47" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c89e47: serviceaccount "payload-processing-e2e-ipp-b-c89e47" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ae8879-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ae8879-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ebcc6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-872f4a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-872f4a-594bc8cc8 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ebcc6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-872f4a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

ProbeError

Startup probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

Unhealthy

Startup probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-872f4a: serviceaccount "payload-processing-e2e-ipp-a-872f4a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-872f4a-594bc8cc8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-872f4a-594bc8cc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-872f4a: serviceaccount "payload-processing-e2e-ipp-a-872f4a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-872f4a-594bc8cc8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ebcc6d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ebcc6d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-d09fff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-d09fff-openshift-default-86957cb9c9 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-d09fff-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-d09fff-openshift-default-86957cb9c9

SuccessfulDelete

Deleted pod: e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj
(x5)

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-kl5gj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-923d78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-923d78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ae8879-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-ae8879-openshift-default-5bc8464785

SuccessfulCreate

Created pod: e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

openshift-ingress

replicaset-controller

e2e-praxis-a-ae8879-openshift-default-5bc8464785

SuccessfulCreate

Created pod: e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

openshift-ingress

deployment-controller

e2e-praxis-a-ae8879-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ae8879-openshift-default-5bc8464785 from 1 to 4

openshift-ingress

multus

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-ae8879-openshift-default-5bc8464785

SuccessfulCreate

Created pod: e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

openshift-ingress

multus

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

ProbeError

Readiness probe error: Get "http://10.133.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

Unhealthy

Readiness probe failed: Get "http://10.133.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

ProbeError

Startup probe error: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

Unhealthy

Startup probe failed: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

Unhealthy

Startup probe failed: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

ProbeError

Startup probe error: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ae8879-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ae8879-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-923d78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-923d78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3bd7fe-8468ff4697-wlwx8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3bd7fe-68d9f4cc99-tksgk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

ProbeError

Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

Unhealthy

Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-40fb42-677f5fcd55-rfdss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-40fb42-77fcf46b47-tj85w

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-gz787

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-f84b2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-sxjs7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-7hsfv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-sxjs7

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-7hsfv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6f54779779-f84b2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gz787

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 10 to 6

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-46w54
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c89e47-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c89e47-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-7f66ab-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869

SuccessfulDelete

Deleted pod: e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

openshift-ingress

deployment-controller

e2e-worker-w2-7f66ab-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-7f66ab-openshift-default-5cbbd48869 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-nplkr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-praxis-b-cf5019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-cf5019-openshift-default-86d845b745 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-cf5019

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-cf5019

openshift-ingress

replicaset-controller

e2e-praxis-b-cf5019-openshift-default-86d845b745

SuccessfulCreate

Created pod: e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

openshift-ingress

multus

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-3bd7fe-openshift-default-64596c8d97-jgh75

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-cf5019

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-cf5019-6bd7498b77 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-cf5019

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c89e47-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c89e47-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cf5019: serviceaccount "payload-processing-e2e-praxis-b-cf5019" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cf5019-6bd7498b77

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-cf5019-6bd7498b77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cf5019: serviceaccount "payload-processing-e2e-praxis-b-cf5019" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cf5019-6bd7498b77

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c89e47-865cb6cd4c-46vtl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c89e47-68c7b5fd55-zkb2t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e90fe-75596d59bd-g5dwz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ebcc6d-787f588799-sb9m4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e90fe-fd5fbf895-frbjv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ebcc6d-5999fdd579-gpdwv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-40fb42-openshift-default-6858979c77-hbgs8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-923d78-74b6b4f5bc-4n267

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-923d78-5cdf899975-56sdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-872f4a-594bc8cc8-hhfqm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-872f4a-5956df65bc-9z8zf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-872f4a-openshift-default-c5f469f79-6rw95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-0e90fe-openshift-default-5d495cbd97-vg6bq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-c89e47-openshift-default-75d6698785-ggftd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-459aa8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-459aa8

openshift-ingress

replicaset-controller

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949

SuccessfulCreate

Created pod: e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

openshift-ingress

deployment-controller

e2e-praxis-a-459aa8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-459aa8-openshift-default-6fcfd7f949 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-ebcc6d-openshift-default-58cb964577-ltvvb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6a3357-5685c57f46-2ktgv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6a3357-5bfd68c7cf-w7tsp

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-459aa8: serviceaccount "payload-processing-e2e-praxis-a-459aa8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-459aa8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-459aa8-5dff44787f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-459aa8-5dff44787f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-459aa8-5dff44787f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-459aa8: serviceaccount "payload-processing-e2e-praxis-a-459aa8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-459aa8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-459aa8-5dff44787f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-6a3357-openshift-default-664b5474c9-2mmgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-923d78-openshift-default-b68d59d6f-wl9q6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-praxis-a-1875b4-openshift-default-54b87966f

SuccessfulCreate

Created pod: e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-1875b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-1875b4

openshift-ingress

deployment-controller

e2e-praxis-a-1875b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1875b4-openshift-default-54b87966f from 0 to 1

openshift-ingress

multus

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-1875b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-1875b4-785945b489 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1875b4-785945b489

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1875b4-785945b489

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-1875b4-785945b489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1875b4: serviceaccount "payload-processing-e2e-praxis-a-1875b4" not found
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1875b4: serviceaccount "payload-processing-e2e-praxis-a-1875b4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-1875b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Started

Container started

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ae8879-594df77f75-qv5xs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ae8879-6b5d57574c-qbwjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-bg5qs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-4tldv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-wkwvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ae8879-openshift-default-5bc8464785-cn2dz

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cf5019-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cf5019-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cf5019-6bd7498b77-72hjg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cf5019-79f6d98479-pm5v6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-459aa8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-459aa8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-b-c301cf-openshift-default-849d8fb757

SuccessfulCreate

Created pod: e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-c301cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-c301cf

openshift-ingress

deployment-controller

e2e-praxis-b-c301cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-c301cf-openshift-default-849d8fb757 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

openshift-ingress

multus

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

Created

Container created

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-459aa8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-459aa8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 6 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

Unhealthy

Startup probe failed: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-gqbnx

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

ProbeError

Startup probe error: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-c301cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-c301cf-7889f5fbbf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c301cf: serviceaccount "payload-processing-e2e-praxis-b-c301cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-c301cf: serviceaccount "payload-processing-e2e-praxis-b-c301cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-c301cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-2qq6c

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-2qq6c

Killing

Stopping container discovery

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-svxzp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

openshift-ingress

deployment-controller

e2e-praxis-b-28f124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-28f124-openshift-default-98987bd97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-28f124

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-28f124

openshift-ingress

multus

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-28f124-openshift-default-98987bd97

SuccessfulCreate

Created pod: e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-ddr54

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-28f124-58d9dffc6c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-28f124-58d9dffc6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-28f124: serviceaccount "payload-processing-e2e-praxis-b-28f124" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-28f124

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-28f124: serviceaccount "payload-processing-e2e-praxis-b-28f124" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-28f124

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-28f124-58d9dffc6c from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1875b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1875b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-28f124-58d9dffc6c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

openshift-ingress

multus

payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 2 to 4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-cf5019-openshift-default-86d845b745-qtwlr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

Created

Container created

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.91s (5.91s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 5.741s (5.741s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

Unhealthy

Startup probe failed: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

ProbeError

Startup probe error: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-28f124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-28f124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1875b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1875b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 4 to 5

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

Created

Container created

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulCreate

Created pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

Started

Container started

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

Unhealthy

Startup probe failed: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

ProbeError

Startup probe error: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-9717a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-9717a8

openshift-ingress

replicaset-controller

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f

SuccessfulCreate

Created pod: e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

openshift-ingress

deployment-controller

e2e-shared-a-w2-9717a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-9717a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-9717a8-6c58658699 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9717a8-6c58658699

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-9717a8-6c58658699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9717a8: serviceaccount "payload-processing-e2e-shared-a-w2-9717a8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-9717a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9717a8-6c58658699

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9717a8: serviceaccount "payload-processing-e2e-shared-a-w2-9717a8" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w4-f39eb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-f39eb7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-f39eb7

openshift-ingress

replicaset-controller

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55

SuccessfulCreate

Created pod: e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

openshift-ingress

multus

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

ProbeError

Readiness probe error: Get "http://10.132.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Unhealthy

Readiness probe failed: Get "http://10.132.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-f39eb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-f39eb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-f39eb7: serviceaccount "payload-processing-e2e-shared-a-w4-f39eb7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-f39eb7: serviceaccount "payload-processing-e2e-shared-a-w4-f39eb7" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-28f124-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-b-28f124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-28f124-openshift-default-98987bd97 from 1 to 2

openshift-ingress

replicaset-controller

e2e-praxis-b-28f124-openshift-default-98987bd97

SuccessfulCreate

Created pod: e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

ProbeError

Startup probe error: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

Started

Container started

openshift-ingress

multus

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

Unhealthy

Startup probe failed: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

ProbeError

Startup probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

Unhealthy

Startup probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulCreate

Created pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

Started

Container started

openshift-ingress

multus

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Unhealthy

Readiness probe failed: Get "http://10.133.0.197:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

ProbeError

Readiness probe error: Get "http://10.133.0.197:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

ProbeError

Startup probe error: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w3-fc6466-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7

SuccessfulCreate

Created pod: e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

Unhealthy

Startup probe failed: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-fc6466

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-fc6466

openshift-ingress

multus

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Started

Container started
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Unhealthy

Readiness probe failed: Get "https://10.132.0.57:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-2kn7t

Unhealthy

Readiness probe failed: Get "https://10.132.0.57:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-459aa8-5dff44787f-9jnb4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-459aa8-58d457ff5f-7vbfh

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

ProbeError

Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Unhealthy

Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-fc6466

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-fc6466: serviceaccount "payload-processing-e2e-shared-a-w3-fc6466" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-fc6466: serviceaccount "payload-processing-e2e-shared-a-w3-fc6466" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-fc6466

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-28f124-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-28f124-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c301cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c301cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-459aa8-openshift-default-6fcfd7f949-r555g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c301cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-c301cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-c301cf-7957b4776c-qt4cp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-c301cf-7889f5fbbf-r7xtx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

ProbeError

Readiness probe error: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

Unhealthy

Readiness probe failed: Get "http://10.132.0.145:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f39eb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f39eb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-9717a8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-9717a8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w2-68f80c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-68f80c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-68f80c

openshift-ingress

replicaset-controller

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7

SuccessfulCreate

Created pod: e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

openshift-ingress

multus

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-68f80c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-68f80c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-fc6466-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-68f80c: serviceaccount "payload-processing-e2e-shared-b-w2-68f80c" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-fc6466-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-68f80c: serviceaccount "payload-processing-e2e-shared-b-w2-68f80c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f39eb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-f39eb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-37e79b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-37e79b
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w4-37e79b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7

SuccessfulCreate

Created pod: e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-37e79b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-37e79b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-37e79b-7f869b84f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-37e79b: serviceaccount "payload-processing-e2e-shared-b-w4-37e79b" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-37e79b: serviceaccount "payload-processing-e2e-shared-b-w4-37e79b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-3b392d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf

SuccessfulCreate

Created pod: e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-3b392d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-3b392d

openshift-ingress

multus

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-c301cf-openshift-default-849d8fb757-99z6w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-3b392d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3b392d: serviceaccount "payload-processing-e2e-shared-a-w0-3b392d" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3b392d: serviceaccount "payload-processing-e2e-shared-a-w0-3b392d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-3b392d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-fc6466-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-fc6466-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-435923

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-435923

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 4 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-435923-openshift-default-658c6d685f

SuccessfulCreate

Created pod: e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

openshift-ingress

deployment-controller

e2e-shared-b-w3-435923-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-435923-openshift-default-658c6d685f from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-h2z4h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-8rl4t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-435923

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-435923

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-435923-5f7478d95c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-435923-5f7478d95c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-435923-5f7478d95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-435923: serviceaccount "payload-processing-e2e-shared-b-w3-435923" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-435923-5f7478d95c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-435923: serviceaccount "payload-processing-e2e-shared-b-w3-435923" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-3b392d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-3b392d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

Unhealthy

Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

ProbeError

Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-68f80c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-68f80c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1875b4-bf5c6b5c9-jxk52

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1875b4-785945b489-gx84b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-68f80c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-68f80c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

Unhealthy

Startup probe failed: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

Unhealthy

Startup probe failed: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

ProbeError

Startup probe error: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

ProbeError

Startup probe error: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

ProbeError

Readiness probe error: Get "http://10.134.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

Unhealthy

Readiness probe failed: Get "http://10.134.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-37e79b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-37e79b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

Unhealthy

Startup probe failed: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

ProbeError

Startup probe error: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-3b392d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-3b392d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w0-74bb81-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-74bb81-openshift-default-79ff795889 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-74bb81

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-74bb81

openshift-ingress

replicaset-controller

e2e-shared-b-w0-74bb81-openshift-default-79ff795889

SuccessfulCreate

Created pod: e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

openshift-ingress

multus

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-435923-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-435923-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-74bb81: serviceaccount "payload-processing-e2e-shared-b-w0-74bb81" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-74bb81: serviceaccount "payload-processing-e2e-shared-b-w0-74bb81" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-74bb81

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-74bb81

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

AddedInterface

Add eth0 [10.133.0.224/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-28f124-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-praxis-b-28f124-openshift-default-98987bd97

SuccessfulDelete

Deleted pod: e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

openshift-ingress

deployment-controller

e2e-praxis-b-28f124-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-praxis-b-28f124-openshift-default-98987bd97 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4bgb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

ProbeError

Readiness probe error: Get "http://10.132.0.136:15021/healthz/ready": EOF body:

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-nxncv

Unhealthy

Readiness probe failed: Get "http://10.132.0.136:15021/healthz/ready": EOF

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-55pwt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-wndjv

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

ProbeError

Readiness probe error: Get "http://10.132.0.134:15021/healthz/ready": EOF body:

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-q78lh

Unhealthy

Readiness probe failed: Get "http://10.132.0.134:15021/healthz/ready": EOF

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

ProbeError

Readiness probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-qgz9s

Unhealthy

Readiness probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

ProbeError

Readiness probe error: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-4wc9z

Unhealthy

Readiness probe failed: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

ProbeError

Readiness probe error: Get "http://10.134.0.151:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-gxjn5

Unhealthy

Readiness probe failed: Get "http://10.134.0.151:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

ProbeError

Readiness probe error: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-44mgb

Unhealthy

Readiness probe failed: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-28wqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4vz5b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

ProbeError

Readiness probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-l7px4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wdm7z

Unhealthy

Readiness probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-74bb81-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-74bb81-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-1875b4-openshift-default-54b87966f-kgbbt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-74bb81-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-74bb81-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-28f124-5765fcc8c-94wfr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-28f124-58d9dffc6c-rhhk9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6f54779779-58nlg

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6f54779779

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-6f54779779-58nlg

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6f54779779 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-m9ztb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-cdpch

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-28f124-openshift-default-98987bd97-f6fjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-explicit-cbe3a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-cbe3a9

openshift-ingress

replicaset-controller

e2e-explicit-cbe3a9-openshift-default-687964c589

SuccessfulCreate

Created pod: e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

openshift-ingress

multus

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-cbe3a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-cbe3a9-openshift-default-687964c589 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cbe3a9-8495794667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-cbe3a9-8495794667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cbe3a9: serviceaccount "payload-processing-e2e-explicit-cbe3a9" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cbe3a9-c7485d8c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-cbe3a9-c7485d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cbe3a9: serviceaccount "payload-processing-e2e-explicit-cbe3a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-cbe3a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-cbe3a9-c7485d8c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-cbe3a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-cbe3a9-8495794667 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cbe3a9-8495794667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulCreate

Created pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cbe3a9-c7485d8c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

Unhealthy

Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

ProbeError

Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused

opendatahub

kubelet

test-curl-7706-2ecef3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7706-2ecef3

Created

Container created

opendatahub

kubelet

test-curl-7706-2ecef3

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-cbe3a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-cbe3a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

test-curl-7706-2ecef3

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7706-2ecef3

Killing

Stopping container test-curl-7706-2ecef3

opendatahub

kubelet

test-curl-7706-7865fd

Created

Container created

opendatahub

multus

test-curl-7706-7865fd

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7706-7865fd

Started

Container started

opendatahub

kubelet

test-curl-7706-7865fd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7706-7865fd

Killing

Stopping container test-curl-7706-7865fd

opendatahub

multus

test-curl-7706-fa1a75

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7706-fa1a75

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7706-fa1a75

Created

Container created

opendatahub

kubelet

test-curl-7706-fa1a75

Started

Container started

opendatahub

kubelet

test-curl-7706-a386f9

Created

Container created

opendatahub

multus

test-curl-7706-a386f9

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7706-a386f9

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7706-fa1a75

Killing

Stopping container test-curl-7706-fa1a75

opendatahub

kubelet

test-curl-7706-a386f9

Started

Container started

opendatahub

multus

test-curl-7706-7e4494

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7706-7e4494

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7706-a386f9

Killing

Stopping container test-curl-7706-a386f9

opendatahub

kubelet

test-curl-7706-7e4494

Started

Container started

opendatahub

kubelet

test-curl-7706-7e4494

Created

Container created

opendatahub

multus

test-curl-7706-fc6448

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7706-7e4494

Killing

Stopping container test-curl-7706-7e4494
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-cbe3a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-cbe3a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7706-fc6448

Created

Container created

opendatahub

kubelet

test-curl-7706-fc6448

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7706-fc6448

Started

Container started

opendatahub

kubelet

test-curl-7706-fc6448

Killing

Stopping container test-curl-7706-fc6448

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulCreate

Created pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-421286

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-421286

openshift-ingress

deployment-controller

e2e-extmod-a-421286-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-421286-openshift-default-84969cfcdf from 0 to 1

openshift-ingress

multus

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-421286

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-421286-677d995c69 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-421286: serviceaccount "payload-processing-e2e-extmod-a-421286" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-421286

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-421286-db4c74cb7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-421286-677d995c69

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-421286-677d995c69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-421286: serviceaccount "payload-processing-e2e-extmod-a-421286" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-421286-677d995c69

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-e524ce-openshift-default-85978f56c7

SuccessfulDelete

Deleted pod: e2e-worker-w4-e524ce-openshift-default-85978f56c7-l94c7
(x6)

openshift-ingress

deployment-controller

e2e-worker-w4-e524ce-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-e524ce-openshift-default-85978f56c7 from 3 to 1

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-e524ce-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-wcctv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 3 to 2

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-4lh6l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cbe3a9-8495794667-xlqrw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cbe3a9-c7485d8c-xz9bh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-extmod-a-b829bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-b829bc-openshift-default-586c94979c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-b829bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-b829bc

openshift-ingress

replicaset-controller

e2e-extmod-a-b829bc-openshift-default-586c94979c

SuccessfulCreate

Created pod: e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

openshift-ingress

multus

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-b829bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-b829bc-68fd448855 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-b829bc: serviceaccount "payload-processing-e2e-extmod-a-b829bc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-b829bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-b829bc: serviceaccount "payload-processing-e2e-extmod-a-b829bc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-421286-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-421286-openshift-default-84969cfcdf from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulCreate

Created pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulCreate

Created pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulCreate

Created pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b
(x2)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

Started

Container started

openshift-ingress

multus

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

Created

Container created

openshift-ingress

multus

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

Created

Container created

openshift-ingress

multus

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

Unhealthy

Startup probe failed: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

Unhealthy

Startup probe failed: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

ProbeError

Startup probe error: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

ProbeError

Startup probe error: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7700-2a919c

Created

Container created

opendatahub

kubelet

test-curl-7700-2a919c

Started

Container started

opendatahub

multus

test-curl-7700-2a919c

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7700-2a919c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-9a60dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-9a60dd

openshift-ingress

deployment-controller

e2e-extmod-a-9a60dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-9a60dd-openshift-default-8d7648469 from 0 to 1

opendatahub

kubelet

test-curl-7700-2a919c

Killing

Stopping container test-curl-7700-2a919c

openshift-ingress

replicaset-controller

e2e-extmod-a-9a60dd-openshift-default-8d7648469

SuccessfulCreate

Created pod: e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

openshift-ingress

multus

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9a60dd: serviceaccount "payload-processing-e2e-extmod-a-9a60dd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-9a60dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-9a60dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9a60dd: serviceaccount "payload-processing-e2e-extmod-a-9a60dd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulCreate

Created pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

openshift-ingress

multus

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-421286-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-421286-openshift-default-84969cfcdf from 4 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

Started

Container started

openshift-ingress

multus

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

AddedInterface

Add eth0 [10.133.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulCreate

Created pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulCreate

Created pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

Created

Container created

openshift-ingress

kubelet

e2e-explicit-cbe3a9-openshift-default-687964c589-7dw2t

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-6587ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6587ea

openshift-ingress

deployment-controller

e2e-noten-6587ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6587ea-openshift-default-549c57899c from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-6587ea-openshift-default-549c57899c

SuccessfulCreate

Created pod: e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

Started

Container started

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

Created

Container created

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

ProbeError

Startup probe error: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

Unhealthy

Startup probe failed: Get "http://10.132.0.175:15021/healthz/ready": dial tcp 10.132.0.175:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

Unhealthy

Startup probe failed: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

ProbeError

Startup probe error: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

Unhealthy

Startup probe failed: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

ProbeError

Startup probe error: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf

SuccessfulCreate

Created pod: e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

openshift-ingress

deployment-controller

e2e-extmod-b-1b5075-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-1b5075-openshift-default-84f49cd6bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-1b5075

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-1b5075

openshift-ingress

multus

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes
(x6)

openshift-ingress

deployment-controller

e2e-worker-w3-b47e8d-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-b47e8d-openshift-default-76b78dfdff from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff

SuccessfulDelete

Deleted pod: e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b47e8d-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-hwdqz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9a60dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9a60dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1b5075: serviceaccount "payload-processing-e2e-extmod-b-1b5075" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-1b5075

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-1b5075

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-1b5075-79b4598787 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-1b5075: serviceaccount "payload-processing-e2e-extmod-b-1b5075" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-6587ea-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-6587ea-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-autores-dcde03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-dcde03

openshift-ingress

replicaset-controller

e2e-autores-dcde03-openshift-default-bd5cc4777

SuccessfulCreate

Created pod: e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

openshift-ingress

multus

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-dcde03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-dcde03-openshift-default-bd5cc4777 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b829bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b829bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-dcde03-55fb4d67ff

FailedCreate

Error creating: pods "payload-processing-e2e-autores-dcde03-55fb4d67ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-dcde03: serviceaccount "payload-processing-e2e-autores-dcde03" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-dcde03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-dcde03-b87bd6bdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-dcde03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-dcde03-55fb4d67ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-dcde03-55fb4d67ff

SuccessfulCreate

Created pod: payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8

openshift-ingress

multus

payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-dcde03: serviceaccount "payload-processing-e2e-autores-dcde03" not found
(x5)

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq

AddedInterface

Add eth0 [10.133.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-e65019-openshift-default-7b9c7cd659

SuccessfulDelete

Deleted pod: e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-e65019-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-e65019-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-e65019-openshift-default-7b9c7cd659 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

Unhealthy

Readiness probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-wgtrs

ProbeError

Readiness probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dcde03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dcde03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b829bc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-b829bc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-noten-6587ea-openshift-default-549c57899c-xv7qk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-f4e241

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-f4e241

openshift-ingress

replicaset-controller

e2e-extmod-b-f4e241-openshift-default-66676d5865

SuccessfulCreate

Created pod: e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

openshift-ingress

deployment-controller

e2e-extmod-b-f4e241-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-f4e241-openshift-default-66676d5865 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f4e241-c9f759785

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-f4e241-c9f759785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f4e241: serviceaccount "payload-processing-e2e-extmod-b-f4e241" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-f4e241

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-f4e241-695766bf9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f4e241: serviceaccount "payload-processing-e2e-extmod-b-f4e241" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-f4e241

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-f4e241-c9f759785 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f4e241-c9f759785

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-031eee-openshift-default-55d57b55c7

SuccessfulCreate

Created pod: e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

openshift-ingress

deployment-controller

e2e-extmod-a-031eee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-031eee-openshift-default-55d57b55c7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-031eee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-031eee
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9a60dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9a60dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

ProbeError

Readiness probe error: Get "http://10.132.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Unhealthy

Readiness probe failed: Get "http://10.132.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-031eee: serviceaccount "payload-processing-e2e-extmod-a-031eee" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-031eee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-031eee-69f7cb7fd5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-031eee: serviceaccount "payload-processing-e2e-extmod-a-031eee" not found
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-031eee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1b5075-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1b5075-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-293c80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-293c80-openshift-default-849b7998bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-293c80-openshift-default-849b7998bf

SuccessfulCreate

Created pod: e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-293c80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-293c80

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

ProbeError

Readiness probe error: Get "http://10.132.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Unhealthy

Readiness probe failed: Get "http://10.132.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-293c80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-293c80-76cd699cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-293c80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-293c80-7947b7869f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n

AddedInterface

Add eth0 [10.133.0.239/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-293c80-76cd699cf

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-293c80-76cd699cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-293c80: serviceaccount "payload-processing-e2e-extmod-b-293c80" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-293c80-76cd699cf

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-293c80: serviceaccount "payload-processing-e2e-extmod-b-293c80" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

ProbeError

Startup probe error: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Unhealthy

Startup probe failed: Get "http://10.132.0.178:15021/healthz/ready": dial tcp 10.132.0.178:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1b5075-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-1b5075-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dcde03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-dcde03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-293c80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-293c80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f4e241-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f4e241-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-autores-dcde03-55fb4d67ff-k8rv8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-dcde03-b87bd6bdc-7bjtq

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulDelete

Deleted pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

openshift-ingress

deployment-controller

e2e-extmod-a-421286-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-421286-openshift-default-84969cfcdf from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-d8xwh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-031eee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-031eee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f4e241-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f4e241-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-031eee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-031eee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-b829bc-68fd448855-8plwg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-b829bc-cb6f9fb5f-q7zwb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-421286-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-421286-openshift-default-84969cfcdf from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulDelete

Deleted pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-031eee-69f7cb7fd5-tnckb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-031eee-59b67ccc55-9sw65

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

Unhealthy

Readiness probe failed: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-7bvks

ProbeError

Readiness probe error: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-a-421286-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-421286-openshift-default-84969cfcdf from 5 to 3

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulDelete

Deleted pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulDelete

Deleted pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-rkcbw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-c7k85

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-031eee-openshift-default-55d57b55c7-8qllg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-9626a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-9626a6

openshift-ingress

replicaset-controller

e2e-extmod-a-9626a6-openshift-default-75b445487c

SuccessfulCreate

Created pod: e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

openshift-ingress

deployment-controller

e2e-extmod-a-9626a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-9626a6-openshift-default-75b445487c from 0 to 1

openshift-ingress

multus

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-dcde03-openshift-default-bd5cc4777-v8tjt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9626a6-8547bc8687

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-9626a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-9626a6-8547bc8687 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9626a6: serviceaccount "payload-processing-e2e-extmod-a-9626a6" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9626a6-8547bc8687

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-9626a6-8547bc8687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9626a6: serviceaccount "payload-processing-e2e-extmod-a-9626a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-9626a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-421286-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-421286-openshift-default-84969cfcdf from 3 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-421286-openshift-default-84969cfcdf

SuccessfulDelete

Deleted pod: e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-421286-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9a60dd-79f5bb4d9f-9qb9p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-xwx5b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-293c80-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9a60dd-68b9bd86c-whklq

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-293c80-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-e65019-789f4df9d5-l2fz8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-e65019-7b9975cdc9-ckrwb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-b829bc-openshift-default-586c94979c-x52ms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f4e241-695766bf9-2wfvt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f4e241-c9f759785-2sqcv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-9a60dd-openshift-default-8d7648469-6nfql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-293c80-76cd699cf-bl6t8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-293c80-7947b7869f-fnm9n

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9626a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9626a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-f4e241-openshift-default-66676d5865-nz94x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9626a6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9626a6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-f39eb7-openshift-default-8f6d9df55-5cl9c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-e65019-openshift-default-7b9c7cd659-bs8hp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-f39eb7-64dbc9bd59-vzxst

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-f39eb7-6cdcd8d7b5-nm8kz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-extmod-b-3b871a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-3b871a-openshift-default-84d65fc85c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-3b871a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-3b871a

openshift-ingress

replicaset-controller

e2e-extmod-b-3b871a-openshift-default-84d65fc85c

SuccessfulCreate

Created pod: e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

openshift-ingress

multus

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-3b871a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-3b871a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-3b871a-7887df7cd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3b871a: serviceaccount "payload-processing-e2e-extmod-b-3b871a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3b871a-7887df7cd9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3b871a-7887df7cd9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-3b871a-7887df7cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3b871a: serviceaccount "payload-processing-e2e-extmod-b-3b871a" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-421286-677d995c69-fpl4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-421286-db4c74cb7-ph9l6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-293c80-openshift-default-849b7998bf-nntwr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w4-37e79b-openshift-default-57f4bf6db7-2bxhq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-37e79b-7f869b84f-tgw8r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-37e79b-69f97b7455-7cln5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

ProbeError

Readiness probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-fc6466-openshift-default-6dcbd54cd7-f8vm2

Unhealthy

Readiness probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-fc6466-6995fc8bc5-fdghg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-fc6466-59f85f75d9-8jrsh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e524ce-566b866699-kh548

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e524ce-7f6847f7bc-flnfd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-435923-5cbcfb6f79-hvr77

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-435923-5f7478d95c-9dc6n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-lcxv2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-421286-openshift-default-84969cfcdf-cllls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

Unhealthy

Readiness probe failed: Get "http://10.132.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

ProbeError

Readiness probe error: Get "http://10.132.0.191:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3b871a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3b871a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-1b5075-6b8f5b6d97-d8cng

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-1b5075-79b4598787-57xh9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-435923-openshift-default-658c6d685f-nl6hm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3b871a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3b871a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b47e8d-555f77c5b5-9qnmq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-1b5075-openshift-default-84f49cd6bf-ppv4l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b47e8d-6d9ff66fcf-kzjsh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-e524ce-openshift-default-85978f56c7-sdtd6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-9717a8-openshift-default-6cb976d54f-wxmf4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9626a6-8547bc8687-5xsjb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9626a6-c8865b65f-gkpv2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9717a8-5b68568959-cs2q2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9717a8-6c58658699-zfk7p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-68f80c-85b9b7d5c-9tt9d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-b47e8d-openshift-default-76b78dfdff-wvrln

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-68f80c-5b57d799c9-rzcr6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-9626a6-openshift-default-75b445487c-7lq27

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-68f80c-openshift-default-576bb9b6b7-bsjbs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3b871a-7887df7cd9-8bpjf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3b871a-6b96b7c47f-j5pjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-extmod-b-3b871a-openshift-default-dockercfg-s9764); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-extmod-b-3b871a-openshift-default-84d65fc85c-lrxk9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-7f66ab-747b4fcdb7-jb99h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-7f66ab-6b68bd85cf-w9lbg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-7f66ab-openshift-default-5cbbd48869-d42dv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3b392d-7d45498b8c-2d5st

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3b392d-5f56c784d7-2jnsx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-3b392d-openshift-default-7559dd76bf-zlj8j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-74bb81-66c8ffbfdc-6mqdc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-74bb81-openshift-default-79ff795889-n5p4k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-74bb81-5f97856699-sphwd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d09fff-7bfdd689b5-kjmmw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d09fff-6568ddc9f-jj88j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-d09fff-openshift-default-86957cb9c9-gjcrd

Killing

Stopping container istio-proxy